Nov 13 23:09:54 user nova-compute[75307]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75307) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75307) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75307) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 13 23:09:54 user nova-compute[75307]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:09:54 user nova-compute[75307]: INFO nova.virt.driver [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 13 23:09:54 user nova-compute[75307]: INFO nova.compute.provider_config [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Acquiring lock "singleton_lock" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Acquired lock "singleton_lock" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Releasing lock "singleton_lock" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Full set of CONF: {{(pid=75307) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ******************************************************************************** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Configuration options gathered from: {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ================================================================================ {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] allow_resize_to_same_host      = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] arq_binding_timeout            = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] backdoor_port                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] backdoor_socket                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] block_device_allocate_retries  = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] block_device_allocate_retries_interval = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cert                           = self.pem {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute_monitors               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] config_dir                     = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] config_drive_format            = iso9660 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] config_source                  = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] console_host                   = user {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] control_exchange               = nova {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cpu_allocation_ratio           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] daemon                         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] debug                          = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_access_ip_network_name = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_availability_zone      = nova {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_ephemeral_format       = ext4 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_green_pool_size        = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] default_schedule_zone          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] disk_allocation_ratio          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] enable_new_services            = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] enabled_ssl_apis               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] flat_injected                  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] force_config_drive             = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] force_raw_images               = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] graceful_shutdown_timeout      = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] heal_instance_info_cache_interval = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] host                           = user {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_build_timeout         = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_delete_interval       = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_name_template         = instance-%08x {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_usage_audit           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_usage_audit_period    = month {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] internal_service_availability_zone = internal {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] key                            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] live_migration_retry_count     = 30 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_config_append              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_dir                        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_file                       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_options                    = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_rotate_interval            = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_rotate_interval_type       = days {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] log_rotation_type              = none {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] long_rpc_timeout               = 1800 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_concurrent_builds          = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_concurrent_live_migrations = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_concurrent_snapshots       = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_local_block_devices        = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_logfile_count              = 30 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] max_logfile_size_mb            = 200 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] maximum_instance_delete_attempts = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metadata_listen                = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metadata_listen_port           = 8775 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metadata_workers               = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] migrate_max_retries            = -1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] mkisofs_cmd                    = genisoimage {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] my_ip                          = 10.0.0.210 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] network_allocate_retries       = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] osapi_compute_listen_port      = 8774 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] osapi_compute_unique_server_name_scope =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] osapi_compute_workers          = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] password_length                = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] periodic_enable                = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] periodic_fuzzy_delay           = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] pointer_model                  = ps2mouse {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] preallocate_images             = none {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] publish_errors                 = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] pybasedir                      = /opt/stack/nova {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ram_allocation_ratio           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rate_limit_burst               = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rate_limit_except_level        = CRITICAL {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rate_limit_interval            = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reboot_timeout                 = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reclaim_instance_interval      = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] record                         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reimage_timeout_per_gb         = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] report_interval                = 120 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rescue_timeout                 = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reserved_host_cpus             = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reserved_host_disk_mb          = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reserved_host_memory_mb        = 512 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] reserved_huge_pages            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] resize_confirm_window          = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] resize_fs_using_block_device   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] resume_guests_state_on_host_boot = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rpc_response_timeout           = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] run_external_periodic_tasks    = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] running_deleted_instance_action = reap {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] running_deleted_instance_timeout = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler_instance_sync_interval = 120 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_down_time              = 720 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] servicegroup_driver            = db {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] shelved_offload_time           = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] shelved_poll_interval          = 3600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] shutdown_timeout               = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] source_is_ipv6                 = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ssl_only                       = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] state_path                     = /opt/stack/data/nova {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] sync_power_state_interval      = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] sync_power_state_pool_size     = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] syslog_log_facility            = LOG_USER {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] tempdir                        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] timeout_nbd                    = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] transport_url                  = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] update_resources_interval      = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_cow_images                 = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_eventlog                   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_journal                    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_json                       = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_rootwrap_daemon            = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_stderr                     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] use_syslog                     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vcpu_pin_set                   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plugging_is_fatal          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plugging_timeout           = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] virt_mkfs                      = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] volume_usage_poll_interval     = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] watch_log_file                 = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] web                            = /usr/share/spice-html5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_concurrency.disable_process_locking = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.auth_strategy              = keystone {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.compute_link_prefix        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.dhcp_domain                = novalocal {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.enable_instance_password   = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.glance_link_prefix         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.instance_list_per_project_cells = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.list_records_by_skipping_down_cells = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.local_metadata_per_cell    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.max_limit                  = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.metadata_cache_expiration  = 15 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.neutron_default_tenant_id  = default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.use_forwarded_for          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.use_neutron_default_nets   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_dynamic_targets = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_jsonfile_path   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.backend_argument         = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.config_prefix            = cache.oslo {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.dead_timeout             = 60.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.debug_cache_backend      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.enable_retry_client      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.enable_socket_keepalive  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.enabled                  = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.expiration_time          = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.hashclient_retry_attempts = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_dead_retry      = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_password        =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_sasl_enabled    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.memcache_username        =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.proxies                  = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.retry_attempts           = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.retry_delay              = 0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.socket_keepalive_count   = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.socket_keepalive_idle    = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.socket_keepalive_interval = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.tls_allowed_ciphers      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.tls_cafile               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.tls_certfile             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.tls_enabled              = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cache.tls_keyfile              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.auth_section            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.auth_type               = password {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.cafile                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.certfile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.collect_timing          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.cross_az_attach         = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.debug                   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.endpoint_template       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.http_retries            = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.insecure                = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.keyfile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.os_region_name          = RegionOne {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.split_loggers           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cinder.timeout                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.cpu_dedicated_set      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.cpu_shared_set         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.image_type_exclude_list = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.resource_provider_association_refresh = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.shutdown_retry_interval = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] conductor.workers              = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] console.allowed_origins        = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] console.ssl_ciphers            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] console.ssl_minimum_version    = default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] consoleauth.token_ttl          = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.cafile                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.certfile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.collect_timing          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.connect_retries         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.connect_retry_delay     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.endpoint_override       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.insecure                = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.keyfile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.max_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.min_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.region_name             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.service_name            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.service_type            = accelerator {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.split_loggers           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.status_code_retries     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.timeout                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] cyborg.version                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.backend               = sqlalchemy {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.connection            = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.connection_debug      = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.connection_parameters =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.connection_recycle_time = 3600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.connection_trace      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.db_inc_retry_interval = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.db_max_retries        = 20 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.db_max_retry_interval = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.db_retry_interval     = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.max_overflow          = 50 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.max_pool_size         = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.max_retries           = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.mysql_wsrep_sync_wait = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.pool_timeout          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.retry_interval        = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.slave_connection      = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] database.sqlite_synchronous    = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.backend           = sqlalchemy {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.connection        = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.connection_debug  = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.connection_parameters =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.connection_recycle_time = 3600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.connection_trace  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.db_inc_retry_interval = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.db_max_retries    = 20 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.db_max_retry_interval = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.db_retry_interval = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.max_overflow      = 50 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.max_pool_size     = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.max_retries       = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.pool_timeout      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.retry_interval    = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.slave_connection  = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] api_database.sqlite_synchronous = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] devices.enabled_mdev_types     = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ephemeral_storage_encryption.enabled = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.api_servers             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.cafile                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.certfile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.collect_timing          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.connect_retries         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.connect_retry_delay     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.debug                   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.default_trusted_certificate_ids = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.enable_certificate_validation = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.enable_rbd_download     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.endpoint_override       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.insecure                = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.keyfile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.max_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.min_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.num_retries             = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.rbd_ceph_conf           =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.rbd_connect_timeout     = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.rbd_pool                =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.rbd_user                =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.region_name             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.service_name            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.service_type            = image {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.split_loggers           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.status_code_retries     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.timeout                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.verify_glance_signatures = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] glance.version                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] guestfs.debug                  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.config_drive_cdrom      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.config_drive_inject_password = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.enable_remotefx         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.instances_path_share    =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.limit_cpu_features      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.use_multipath_io        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.vswitch_name            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] mks.enabled                    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.manager_interval   = 2400 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.precache_concurrency = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.remove_unused_base_images = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] image_cache.subdirectory_name  = _base {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.api_max_retries         = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.api_retry_interval      = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.auth_section            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.auth_type               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.cafile                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.certfile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.collect_timing          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.conductor_group         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.connect_retries         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.connect_retry_delay     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:54 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.endpoint_override       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.insecure                = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.keyfile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.max_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.min_version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.peer_list               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.region_name             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.serial_console_state_timeout = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.service_name            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.service_type            = baremetal {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.split_loggers           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.status_code_retries     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.timeout                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ironic.version                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] key_manager.fixed_key          = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.barbican_api_version  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.barbican_endpoint     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.barbican_endpoint_type = public {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.barbican_region_name  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.cafile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.certfile              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.collect_timing        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.insecure              = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.keyfile               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.number_of_retries     = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.retry_delay           = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.send_service_user_token = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.split_loggers         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.timeout               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.verify_ssl            = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican.verify_ssl_path       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.auth_section = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.auth_type = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.cafile   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.certfile = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.collect_timing = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.insecure = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.keyfile  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.split_loggers = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] barbican_service_user.timeout  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.approle_role_id          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.approle_secret_id        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.cafile                   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.certfile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.collect_timing           = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.insecure                 = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.keyfile                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.kv_mountpoint            = secret {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.kv_path                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.kv_version               = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.namespace                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.root_token_id            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.split_loggers            = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.ssl_ca_crt_file          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.timeout                  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.use_ssl                  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.auth_section          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.auth_type             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.cafile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.certfile              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.collect_timing        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.connect_retries       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.connect_retry_delay   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.endpoint_override     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.insecure              = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.keyfile               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.max_version           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.min_version           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.region_name           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.service_name          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.service_type          = identity {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.split_loggers         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.status_code_retries   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.timeout               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] keystone.version               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.connection_uri         =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_mode               = custom {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: WARNING oslo_config.cfg [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_power_governor_high = performance {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_power_management   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.device_detach_attempts = 8 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.device_detach_timeout  = 20 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.disk_cachemodes        = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.disk_prefix            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.enabled_perf_events    = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.file_backed_memory     = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.gid_maps               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.hw_disk_discard        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.hw_machine_type        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_rbd_pool        = rbd {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_type            = default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.images_volume_group    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.inject_key             = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.inject_partition       = -2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.inject_password        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.iscsi_iface            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.iser_use_multipath     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_downtime = 500 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_inbound_addr = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_scheme  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_timeout_action = abort {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_tunnelled = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: WARNING oslo_config.cfg [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 13 23:09:55 user nova-compute[75307]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 13 23:09:55 user nova-compute[75307]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 13 23:09:55 user nova-compute[75307]: and ``live_migration_inbound_addr`` respectively.
Nov 13 23:09:55 user nova-compute[75307]: ).  Its value may be silently ignored in the future.
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.live_migration_with_native_tls = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.max_queues             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.nfs_mount_options      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_pcie_ports         = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.pmem_namespaces        = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.quobyte_client_cfg     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rbd_secret_uuid        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rbd_user               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rescue_image_id        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rescue_kernel_id       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.rx_queue_size          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.smbfs_mount_options    =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.snapshot_compression   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.snapshot_image_format  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.sparse_logical_volumes = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.swtpm_enabled          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.swtpm_group            = tss {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.swtpm_user             = tss {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.sysinfo_serial         = unique {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.tb_cache_size          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.tx_queue_size          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.uid_maps               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.use_virtio_for_bridges = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.virt_type              = kvm {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.volume_clear           = zero {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.volume_clear_size      = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.volume_use_multipath   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_cache_path   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.auth_section           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.auth_type              = password {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.cafile                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.certfile               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.collect_timing         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.connect_retries        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.connect_retry_delay    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.default_floating_pool  = public {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.endpoint_override      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.extension_sync_interval = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.http_retries           = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.insecure               = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.keyfile                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.max_version            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.min_version            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.ovs_bridge             = br-int {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.physnets               = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.region_name            = RegionOne {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.service_metadata_proxy = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.service_name           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.service_type           = network {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.split_loggers          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.status_code_retries    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.timeout                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] neutron.version                = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] notifications.bdms_in_notifications = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] notifications.default_level    = INFO {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] notifications.notification_format = unversioned {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] notifications.notify_on_state_change = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] pci.alias                      = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] pci.device_spec                = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] pci.report_in_placement        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.auth_section         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.auth_type            = password {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.cafile               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.certfile             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.collect_timing       = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.connect_retries      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.connect_retry_delay  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.default_domain_id    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.default_domain_name  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.domain_id            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.domain_name          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.endpoint_override    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.insecure             = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.keyfile              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.max_version          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.min_version          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.password             = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.project_domain_id    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.project_domain_name  = Default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.project_id           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.project_name         = service {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.region_name          = RegionOne {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.service_name         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.service_type         = placement {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.split_loggers        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.status_code_retries  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.system_scope         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.timeout              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.trust_id             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.user_domain_id       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.user_domain_name     = Default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.user_id              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.username             = placement {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] placement.version              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.cores                    = 20 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.count_usage_from_placement = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.injected_file_content_bytes = 10240 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.injected_file_path_length = 255 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.injected_files           = 5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.instances                = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.key_pairs                = 100 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.metadata_items           = 128 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.ram                      = 51200 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.recheck_quota            = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.server_group_members     = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] quota.server_groups            = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rdp.enabled                    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.image_metadata_prefilter = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.max_attempts         = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.max_placement_results = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] scheduler.workers              = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.host_subset_size = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.isolated_hosts = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.isolated_images = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.pci_in_placement = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.track_instance_changes = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metrics.required               = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metrics.weight_multiplier      = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] metrics.weight_setting         = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.enabled         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.port_range      = 10000:20000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] serial_console.serialproxy_port = 6083 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.auth_section      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.auth_type         = password {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.cafile            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.certfile          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.collect_timing    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.insecure          = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.keyfile           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.send_service_user_token = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.split_loggers     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] service_user.timeout           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.agent_enabled            = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.enabled                  = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.html5proxy_port          = 6082 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.image_compression        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.jpeg_compression         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.playback_compression     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.server_listen            = 127.0.0.1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.streaming_mode           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] spice.zlib_compression         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] upgrade_levels.baseapi         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] upgrade_levels.cert            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] upgrade_levels.compute         = auto {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] upgrade_levels.conductor       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] upgrade_levels.scheduler       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.cafile = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.certfile = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.insecure = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vendordata_dynamic_auth.timeout = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.api_retry_count         = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.ca_file                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.cache_prefix            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.cluster_name            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.connection_pool_size    = 10 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.console_delay_seconds   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.datastore_regex         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.host_ip                 = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.host_password           = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.host_port               = 443 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.host_username           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.insecure                = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.integration_bridge      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.maximum_objects         = 100 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.pbm_default_policy      = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.pbm_enabled             = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.pbm_wsdl_location       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.serial_port_proxy_uri   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.serial_port_service_uri = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.task_poll_interval      = 0.5 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.use_linked_clone        = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.vnc_keymap              = en-us {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.vnc_port                = 5900 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vmware.vnc_port_total          = 10000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.auth_schemes               = ['none'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.enabled                    = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.novncproxy_port            = 6080 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.vencrypt_ca_certs          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.vencrypt_client_cert       = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vnc.vencrypt_client_key        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.disable_rootwrap   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.enable_numa_live_migration = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.libvirt_disable_apic = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.client_socket_timeout     = 900 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.default_pool_size         = 1000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.keep_alive                = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.max_header_line           = 16384 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.ssl_ca_file               = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.ssl_cert_file             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.ssl_key_file              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.tcp_keepidle              = 600 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] zvm.ca_file                    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] zvm.cloud_connector_url        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] zvm.reachable_timeout          = 300 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.enforce_new_defaults = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.enforce_scope      = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.policy_default_rule = default {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.connection_string     = messaging:// {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.enabled               = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.es_doc_type           = notification {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.es_scroll_size        = 10000 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.es_scroll_time        = 2m {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.filter_error_trace    = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.hmac_keys             = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.sentinel_service_name = mymaster {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.socket_timeout        = 0.1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.trace_requests        = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler.trace_sqlalchemy      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler_jaeger.process_tags   = {} {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler_jaeger.service_name_prefix = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] profiler_otlp.service_name_prefix = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] remote_debug.host              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] remote_debug.port              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_notifications.retry = -1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.auth_section        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.auth_type           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.cafile              = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.certfile            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.collect_timing      = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.connect_retries     = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.connect_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.endpoint_id         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.endpoint_override   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.insecure            = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.keyfile             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.max_version         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.min_version         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.region_name         = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.service_name        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.service_type        = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.split_loggers       = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.status_code_retries = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.status_code_retry_delay = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.timeout             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.valid_interfaces    = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_limit.version             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_reports.file_event_handler = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] oslo_reports.log_dir           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.group  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] vif_plug_ovs_privileged.user   = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.isolate_vif         = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] os_brick.lock_path             = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.capabilities   = [21] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.group          = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.helper_command = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] privsep_osbrick.user           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.group           = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.helper_command  = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] nova_sys_admin.user            = None {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG oslo_service.service [None req-7370c2d6-50a0-41e8-97d3-6c89bfcd8563 None None] ******************************************************************************** {{(pid=75307) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 13 23:09:55 user nova-compute[75307]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Connecting to libvirt: qemu:///system {{(pid=75307) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcb3d07ef80> {{(pid=75307) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 13 23:09:55 user nova-compute[75307]: libvirt:  error : internal error: could not initialize domain event timer
Nov 13 23:09:55 user nova-compute[75307]: WARNING nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcb3d07ef80> {{(pid=75307) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Starting native event thread {{(pid=75307) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Starting green dispatch thread {{(pid=75307) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Starting connection event dispatch thread {{(pid=75307) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 13 23:09:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Connection event '1' reason 'None'
Nov 13 23:09:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 23:09:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.mount [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Initialising _HostMountState generation 0 {{(pid=75307) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 13 23:10:02 user nova-compute[75307]: INFO nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host capabilities <capabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <host>
Nov 13 23:10:02 user nova-compute[75307]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 13 23:10:02 user nova-compute[75307]:     <cpu>
Nov 13 23:10:02 user nova-compute[75307]:       <arch>x86_64</arch>
Nov 13 23:10:02 user nova-compute[75307]:       <model>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <microcode version='1070'/>
Nov 13 23:10:02 user nova-compute[75307]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='osxsave'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='invtsc'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='rsba'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature name='skip-l1dfl-vmentry'/>
Nov 13 23:10:02 user nova-compute[75307]:       <pages unit='KiB' size='4'/>
Nov 13 23:10:02 user nova-compute[75307]:       <pages unit='KiB' size='2048'/>
Nov 13 23:10:02 user nova-compute[75307]:     </cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <power_management>
Nov 13 23:10:02 user nova-compute[75307]:       <suspend_mem/>
Nov 13 23:10:02 user nova-compute[75307]:       <suspend_disk/>
Nov 13 23:10:02 user nova-compute[75307]:       <suspend_hybrid/>
Nov 13 23:10:02 user nova-compute[75307]:     </power_management>
Nov 13 23:10:02 user nova-compute[75307]:     <iommu support='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <migration_features>
Nov 13 23:10:02 user nova-compute[75307]:       <live/>
Nov 13 23:10:02 user nova-compute[75307]:       <uri_transports>
Nov 13 23:10:02 user nova-compute[75307]:         <uri_transport>tcp</uri_transport>
Nov 13 23:10:02 user nova-compute[75307]:         <uri_transport>rdma</uri_transport>
Nov 13 23:10:02 user nova-compute[75307]:       </uri_transports>
Nov 13 23:10:02 user nova-compute[75307]:     </migration_features>
Nov 13 23:10:02 user nova-compute[75307]:     <topology>
Nov 13 23:10:02 user nova-compute[75307]:       <cells num='2'>
Nov 13 23:10:02 user nova-compute[75307]:         <cell id='0'>
Nov 13 23:10:02 user nova-compute[75307]:           <memory unit='KiB'>8140616</memory>
Nov 13 23:10:02 user nova-compute[75307]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 13 23:10:02 user nova-compute[75307]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 23:10:02 user nova-compute[75307]:           <distances>
Nov 13 23:10:02 user nova-compute[75307]:             <sibling id='0' value='10'/>
Nov 13 23:10:02 user nova-compute[75307]:             <sibling id='1' value='20'/>
Nov 13 23:10:02 user nova-compute[75307]:           </distances>
Nov 13 23:10:02 user nova-compute[75307]:           <cpus num='6'>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 13 23:10:02 user nova-compute[75307]:           </cpus>
Nov 13 23:10:02 user nova-compute[75307]:         </cell>
Nov 13 23:10:02 user nova-compute[75307]:         <cell id='1'>
Nov 13 23:10:02 user nova-compute[75307]:           <memory unit='KiB'>8255068</memory>
Nov 13 23:10:02 user nova-compute[75307]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 13 23:10:02 user nova-compute[75307]:           <pages unit='KiB' size='2048'>0</pages>
Nov 13 23:10:02 user nova-compute[75307]:           <distances>
Nov 13 23:10:02 user nova-compute[75307]:             <sibling id='0' value='20'/>
Nov 13 23:10:02 user nova-compute[75307]:             <sibling id='1' value='10'/>
Nov 13 23:10:02 user nova-compute[75307]:           </distances>
Nov 13 23:10:02 user nova-compute[75307]:           <cpus num='6'>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 13 23:10:02 user nova-compute[75307]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 13 23:10:02 user nova-compute[75307]:           </cpus>
Nov 13 23:10:02 user nova-compute[75307]:         </cell>
Nov 13 23:10:02 user nova-compute[75307]:       </cells>
Nov 13 23:10:02 user nova-compute[75307]:     </topology>
Nov 13 23:10:02 user nova-compute[75307]:     <cache>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 13 23:10:02 user nova-compute[75307]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 13 23:10:02 user nova-compute[75307]:     </cache>
Nov 13 23:10:02 user nova-compute[75307]:     <secmodel>
Nov 13 23:10:02 user nova-compute[75307]:       <model>apparmor</model>
Nov 13 23:10:02 user nova-compute[75307]:       <doi>0</doi>
Nov 13 23:10:02 user nova-compute[75307]:     </secmodel>
Nov 13 23:10:02 user nova-compute[75307]:     <secmodel>
Nov 13 23:10:02 user nova-compute[75307]:       <model>dac</model>
Nov 13 23:10:02 user nova-compute[75307]:       <doi>0</doi>
Nov 13 23:10:02 user nova-compute[75307]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 13 23:10:02 user nova-compute[75307]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 13 23:10:02 user nova-compute[75307]:     </secmodel>
Nov 13 23:10:02 user nova-compute[75307]:   </host>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='alpha'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>clipper</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='armv6l'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>spitz</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>nuri</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>kzm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>z2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>tosa</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n810</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>terrier</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>midway</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>microbit</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>verdex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>highbank</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>akita</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>connex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>collie</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='armv7l'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>spitz</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>nuri</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>kzm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>z2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>tosa</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n810</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>terrier</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>midway</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>microbit</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>verdex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>highbank</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>akita</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>connex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>collie</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='aarch64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>integratorcp</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>borzoi</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>spitz</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>nuri</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-b1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatileab</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>kzm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>musca-a</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>smdkc210</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>z2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>tosa</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>sabrelite</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-eb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n810</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>n800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>versatilepb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>terrier</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mainstone</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>midway</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>musicpal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>microbit</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cubieboard</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>verdex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduino2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>raspi3b</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>raspi2b</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>cheetah</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>highbank</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>akita</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>connex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>collie</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>raspi0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <acpi default='on' toggle='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='cris'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='i686'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>isapc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>microvm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='kvm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <pae/>
Nov 13 23:10:02 user nova-compute[75307]:       <nonpae/>
Nov 13 23:10:02 user nova-compute[75307]:       <acpi default='on' toggle='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:       <apic default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='m68k'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>an5206</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>q800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>next-cube</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='microblaze'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='microblazeel'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='mips'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>malta</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='mipsel'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>malta</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='mips64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>malta</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>pica61</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>magnum</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='mips64el'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>malta</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mipssim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>pica61</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>magnum</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='16'>boston</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='ppc'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mac99</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>40p</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>taihu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='ppc64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>taihu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>40p</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mac99</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='ppc64le'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>taihu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ppce500</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>40p</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>pegasos2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>bamboo</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>g3beige</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>mac99</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sam460ex</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>ref405ep</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2048'>powernv8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='riscv32'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='8'>spike</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>opentitan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='8'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='riscv64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='8'>spike</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='5'>sifive_u</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>shakti_c</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sifive_e</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='8'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='s390x'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='sh4'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>shix</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>r2d</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='sh4eb'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>shix</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>r2d</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='sparc'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>SS-5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>SS-20</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>LX</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>SS-4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>SS-10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>Voyager</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='sparc64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sun4u</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>niagara</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>sun4v</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='x86_64'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>64</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>x-remote</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='1'>isapc</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>microvm</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='kvm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <acpi default='on' toggle='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:       <apic default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='xtensa'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>sim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>kc705</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ml605</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx200</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx60</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]:   <guest>
Nov 13 23:10:02 user nova-compute[75307]:     <os_type>hvm</os_type>
Nov 13 23:10:02 user nova-compute[75307]:     <arch name='xtensaeb'>
Nov 13 23:10:02 user nova-compute[75307]:       <wordsize>32</wordsize>
Nov 13 23:10:02 user nova-compute[75307]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='4'>sim</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>kc705</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ml605</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>virt</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx200</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>lx60</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 13 23:10:02 user nova-compute[75307]:       <domain type='qemu'/>
Nov 13 23:10:02 user nova-compute[75307]:     </arch>
Nov 13 23:10:02 user nova-compute[75307]:     <features>
Nov 13 23:10:02 user nova-compute[75307]:       <cpuselection/>
Nov 13 23:10:02 user nova-compute[75307]:       <deviceboot/>
Nov 13 23:10:02 user nova-compute[75307]:       <disksnapshot default='on' toggle='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     </features>
Nov 13 23:10:02 user nova-compute[75307]:   </guest>
Nov 13 23:10:02 user nova-compute[75307]: </capabilities>
Nov 13 23:10:02 user nova-compute[75307]: 
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-i440fx-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>i686</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='255'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'/>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='lm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ide</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-q35-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>i686</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='288'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'/>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='lm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-q35-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>i686</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='288'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'/>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='lm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-i386</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-i440fx-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>i686</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='255'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'/>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='lm'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ide</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu-q35', 'q35', 'ubuntu'} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-i440fx-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>x86_64</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='255'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>efi</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='invtsc'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='rsba'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ide</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-q35-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>x86_64</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='288'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>efi</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='invtsc'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='rsba'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-q35-6.2</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>x86_64</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='288'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>efi</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='invtsc'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='rsba'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 13 23:10:02 user nova-compute[75307]: <domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 13 23:10:02 user nova-compute[75307]:   <domain>kvm</domain>
Nov 13 23:10:02 user nova-compute[75307]:   <machine>pc-i440fx-jammy</machine>
Nov 13 23:10:02 user nova-compute[75307]:   <arch>x86_64</arch>
Nov 13 23:10:02 user nova-compute[75307]:   <vcpu max='255'/>
Nov 13 23:10:02 user nova-compute[75307]:   <iothreads supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:   <os supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='firmware'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>efi</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:     <loader supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>rom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pflash</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='readonly'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>yes</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='secure'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>no</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </loader>
Nov 13 23:10:02 user nova-compute[75307]:   </os>
Nov 13 23:10:02 user nova-compute[75307]:   <cpu>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-passthrough' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='hostPassthroughMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='maximum' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='maximumMigratable'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>on</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>off</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='host-model' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <vendor>Intel</vendor>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ss'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='vmx'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pcid'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='hypervisor'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arat'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='tsc_adjust'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='umip'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='md-clear'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='arch-capabilities'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='invtsc'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibpb'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='ibrs'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-stibp'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='amd-ssbd'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='rsba'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='require' name='pschange-mc-no'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='erms'/>
Nov 13 23:10:02 user nova-compute[75307]:       <feature policy='disable' name='xsaveopt'/>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:     <mode name='custom' supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>qemu64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>qemu32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>phenom</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>pentium</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>n270</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm64</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>kvm32</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>coreduo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>core2duo</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>athlon</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Westmere</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Snowridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Skylake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>SandyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Penryn</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G5</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G4</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G3</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Opteron_G2</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Opteron_G1</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>IvyBridge</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Icelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Haswell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Rome</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-Milan</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC-IBPB</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>EPYC</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Dhyana</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cooperlake</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>Conroe</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Cascadelake-Server</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-noTSX</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell-IBRS</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='no'>Broadwell</model>
Nov 13 23:10:02 user nova-compute[75307]:       <model usable='yes'>486</model>
Nov 13 23:10:02 user nova-compute[75307]:     </mode>
Nov 13 23:10:02 user nova-compute[75307]:   </cpu>
Nov 13 23:10:02 user nova-compute[75307]:   <memoryBacking supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:     <enum name='sourceType'>
Nov 13 23:10:02 user nova-compute[75307]:       <value>file</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>anonymous</value>
Nov 13 23:10:02 user nova-compute[75307]:       <value>memfd</value>
Nov 13 23:10:02 user nova-compute[75307]:     </enum>
Nov 13 23:10:02 user nova-compute[75307]:   </memoryBacking>
Nov 13 23:10:02 user nova-compute[75307]:   <devices>
Nov 13 23:10:02 user nova-compute[75307]:     <disk supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='diskDevice'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>disk</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cdrom</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>floppy</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>lun</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='bus'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ide</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>fdc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sata</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </disk>
Nov 13 23:10:02 user nova-compute[75307]:     <graphics supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='type'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>sdl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vnc</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>spice</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egl-headless</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </graphics>
Nov 13 23:10:02 user nova-compute[75307]:     <video supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='modelType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>cirrus</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>vmvga</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>qxl</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>none</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>bochs</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>ramfb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </video>
Nov 13 23:10:02 user nova-compute[75307]:     <hostdev supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='mode'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>subsystem</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='startupPolicy'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>default</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>mandatory</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>requisite</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>optional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='subsysType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>usb</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>pci</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>scsi</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='capsType'/>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='pciBackend'/>
Nov 13 23:10:02 user nova-compute[75307]:     </hostdev>
Nov 13 23:10:02 user nova-compute[75307]:     <rng supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtio-non-transitional</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>random</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>egd</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>builtin</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </rng>
Nov 13 23:10:02 user nova-compute[75307]:     <filesystem supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='driverType'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>path</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>handle</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>virtiofs</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </filesystem>
Nov 13 23:10:02 user nova-compute[75307]:     <tpm supported='yes'>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='model'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-tis</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>tpm-crb</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:       <enum name='backendModel'>
Nov 13 23:10:02 user nova-compute[75307]:         <value>passthrough</value>
Nov 13 23:10:02 user nova-compute[75307]:         <value>emulator</value>
Nov 13 23:10:02 user nova-compute[75307]:       </enum>
Nov 13 23:10:02 user nova-compute[75307]:     </tpm>
Nov 13 23:10:02 user nova-compute[75307]:   </devices>
Nov 13 23:10:02 user nova-compute[75307]:   <features>
Nov 13 23:10:02 user nova-compute[75307]:     <gic supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:     <vmcoreinfo supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <genid supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backingStoreInput supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <backup supported='yes'/>
Nov 13 23:10:02 user nova-compute[75307]:     <sev supported='no'/>
Nov 13 23:10:02 user nova-compute[75307]:   </features>
Nov 13 23:10:02 user nova-compute[75307]: </domainCapabilities>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75307) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75307) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Checking secure boot support for host arch (x86_64) {{(pid=75307) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Checking secure boot support for host arch (x86_64) {{(pid=75307) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Checking secure boot support for host arch (x86_64) {{(pid=75307) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 13 23:10:02 user nova-compute[75307]: INFO nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Secure Boot support detected
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] cpu compare xml: <cpu match="exact">
Nov 13 23:10:02 user nova-compute[75307]:   <model>Nehalem</model>
Nov 13 23:10:02 user nova-compute[75307]: </cpu>
Nov 13 23:10:02 user nova-compute[75307]:  {{(pid=75307) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 13 23:10:02 user nova-compute[75307]: INFO nova.virt.node [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Generated node identity 29c847ea-f19e-4e70-a7de-654601b2bd95
Nov 13 23:10:02 user nova-compute[75307]: INFO nova.virt.node [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Wrote node identity 29c847ea-f19e-4e70-a7de-654601b2bd95 to /opt/stack/data/nova/compute_id
Nov 13 23:10:02 user nova-compute[75307]: WARNING nova.compute.manager [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Compute nodes ['29c847ea-f19e-4e70-a7de-654601b2bd95'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 13 23:10:02 user nova-compute[75307]: INFO nova.compute.manager [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 13 23:10:02 user nova-compute[75307]: WARNING nova.compute.manager [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 13 23:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:10:02 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:10:02 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:10:02 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Hypervisor/Node resource view: name=user free_ram=10960MB free_disk=26.18560791015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:10:03 user nova-compute[75307]: WARNING nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] No compute node record for user:29c847ea-f19e-4e70-a7de-654601b2bd95: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 29c847ea-f19e-4e70-a7de-654601b2bd95 could not be found.
Nov 13 23:10:03 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Compute node record created for user:user with uuid: 29c847ea-f19e-4e70-a7de-654601b2bd95
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:10:03 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] [req-f90fef40-e2bd-42ec-82dd-035ddf85fa4e] Created resource provider record via placement API for resource provider with UUID 29c847ea-f19e-4e70-a7de-654601b2bd95 and name user.
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75307) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 13 23:10:03 user nova-compute[75307]: INFO nova.virt.libvirt.host [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] kernel doesn't support AMD SEV
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Libvirt baseline CPU <cpu>
Nov 13 23:10:03 user nova-compute[75307]:   <arch>x86_64</arch>
Nov 13 23:10:03 user nova-compute[75307]:   <model>Nehalem</model>
Nov 13 23:10:03 user nova-compute[75307]:   <vendor>Intel</vendor>
Nov 13 23:10:03 user nova-compute[75307]:   <topology sockets="6" cores="1" threads="1"/>
Nov 13 23:10:03 user nova-compute[75307]: </cpu>
Nov 13 23:10:03 user nova-compute[75307]:  {{(pid=75307) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Updated inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Updating resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 generation from 0 to 1 during operation: update_inventory {{(pid=75307) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Updating resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 generation from 1 to 2 during operation: update_traits {{(pid=75307) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.578s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.service [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Creating RPC server for service compute {{(pid=75307) start /opt/stack/nova/nova/service.py:182}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.service [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] Join ServiceGroup membership for this service compute {{(pid=75307) start /opt/stack/nova/nova/service.py:199}}
Nov 13 23:10:03 user nova-compute[75307]: DEBUG nova.servicegroup.drivers.db [None req-cef8e06e-d6af-4df3-ade3-a1415ccdac53 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75307) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:10:59 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:10:59 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:10:59 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=10338MB free_disk=26.089359283447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:10:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:11:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:11:56 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:11:56 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:11:56 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=10305MB free_disk=26.153640747070312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:11:56 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:11:57 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:11:57 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:11:57 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:11:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.144s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:12:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:12:58 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:12:58 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=10295MB free_disk=25.906208038330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:12:58 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:12:59 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:12:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.130s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:13:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:13:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:00 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:14:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:01 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9594MB free_disk=25.925411224365234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:14:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:04 user nova-compute[75307]: INFO nova.compute.claims [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Claim successful on node user
Nov 13 23:14:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:05 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:05 user nova-compute[75307]: INFO nova.compute.claims [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Claim successful on node user
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:05 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Creating image(s)
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "/opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "/opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:05 user nova-compute[75307]: DEBUG nova.policy [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c06379bf565487284e596dceed5d8f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2a08b833bbe4103bed42ccb1d064846', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.887s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.572s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.compute.claims [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Claim successful on node user
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.part --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.virt.images [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.part /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.part /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.converted" returned: 0 in 0.146s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Creating image(s)
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.policy [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca0ce44f4d041b5b98883e3796abe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7260b3ec00fc412091e6db3c55993345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.112s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3z1el33r/privsep.sock']
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.053s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user sudo[84568]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3z1el33r/privsep.sock
Nov 13 23:14:06 user sudo[84568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.283s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.compute.claims [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Claim successful on node user
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Creating image(s)
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:06 user nova-compute[75307]: DEBUG nova.policy [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca0ce44f4d041b5b98883e3796abe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7260b3ec00fc412091e6db3c55993345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:07 user nova-compute[75307]: DEBUG nova.policy [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d8c9bb553d4995bc62521ef2b8bf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e387a1f37b944329bb8f097e8f4ec56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Creating image(s)
Nov 13 23:14:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:07 user sudo[84568]: pam_unix(sudo:session): session closed for user root
Nov 13 23:14:07 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Spawned new privsep daemon via rootwrap
Nov 13 23:14:07 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 23:14:07 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 23:14:07 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 13 23:14:07 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84594
Nov 13 23:14:07 user nova-compute[75307]: WARNING oslo_privsep.priv_context [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] privsep daemon already running
Nov 13 23:14:07 user nova-compute[75307]: WARNING oslo_privsep.priv_context [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] privsep daemon already running
Nov 13 23:14:07 user nova-compute[75307]: WARNING oslo_privsep.priv_context [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] privsep daemon already running
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.164s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Successfully created port: 5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk 1073741824" returned: 0 in 0.044s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Successfully created port: 92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.224s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.207s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk 1073741824" returned: 0 in 0.057s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.483s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Successfully created port: d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Cannot resize image /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Ensure instance console log exists: /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk 1073741824" returned: 0 in 0.043s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.710s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Cannot resize image /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Ensure instance console log exists: /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk 1073741824" returned: 0 in 0.047s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Successfully created port: e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Cannot resize image /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Ensure instance console log exists: /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.227s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Cannot resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Ensure instance console log exists: /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Successfully updated port: d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-changed-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Refreshing instance network info cache due to event network-changed-d6511cea-1a73-4612-bd4b-5a50bd96a3b1. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Successfully updated port: 5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquired lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance network_info: |[{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Refreshing network info cache for port d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start _get_guest_xml network_info=[{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Successfully updated port: 92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:11 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:11 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-changed-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Refreshing instance network info cache due to event network-changed-5f82b533-de1e-4842-b541-7e0532d95fec. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] Acquiring lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:11 user nova-compute[75307]:   <uuid>fdc18eac-a300-4f89-8621-2075decfec01</uuid>
Nov 13 23:14:11 user nova-compute[75307]:   <name>instance-00000004</name>
Nov 13 23:14:11 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:11 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:11 user nova-compute[75307]:   <metadata>
Nov 13 23:14:11 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:11 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeTestJSON-server-15052950</nova:name>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:11</nova:creationTime>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:11 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:11 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:user uuid="19d8c9bb553d4995bc62521ef2b8bf0b">tempest-AttachVolumeTestJSON-1230084994-project-member</nova:user>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:project uuid="e387a1f37b944329bb8f097e8f4ec56b">tempest-AttachVolumeTestJSON-1230084994</nova:project>
Nov 13 23:14:11 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:11 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:11 user nova-compute[75307]:         <nova:port uuid="d6511cea-1a73-4612-bd4b-5a50bd96a3b1">
Nov 13 23:14:11 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 23:14:11 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:11 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:11 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:11 user nova-compute[75307]:   </metadata>
Nov 13 23:14:11 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:11 user nova-compute[75307]:     <system>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="serial">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="uuid">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:14:11 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:11 user nova-compute[75307]:     </system>
Nov 13 23:14:11 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:11 user nova-compute[75307]:   <os>
Nov 13 23:14:11 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:11 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:11 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:11 user nova-compute[75307]:   </os>
Nov 13 23:14:11 user nova-compute[75307]:   <features>
Nov 13 23:14:11 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:11 user nova-compute[75307]:     <apic/>
Nov 13 23:14:11 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:11 user nova-compute[75307]:   </features>
Nov 13 23:14:11 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:11 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:11 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:11 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:11 user nova-compute[75307]:   </clock>
Nov 13 23:14:11 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:11 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:11 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:11 user nova-compute[75307]:   </cpu>
Nov 13 23:14:11 user nova-compute[75307]:   <devices>
Nov 13 23:14:11 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:11 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:11 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk"/>
Nov 13 23:14:11 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:11 user nova-compute[75307]:     </disk>
Nov 13 23:14:11 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:11 user nova-compute[75307]:       <mac address="fa:16:3e:7a:10:97"/>
Nov 13 23:14:11 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:11 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:11 user nova-compute[75307]:       <target dev="tapd6511cea-1a"/>
Nov 13 23:14:11 user nova-compute[75307]:     </interface>
Nov 13 23:14:11 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:11 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/console.log" append="off"/>
Nov 13 23:14:11 user nova-compute[75307]:     </serial>
Nov 13 23:14:11 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:11 user nova-compute[75307]:     <video>
Nov 13 23:14:11 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:11 user nova-compute[75307]:     </video>
Nov 13 23:14:11 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:11 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:11 user nova-compute[75307]:     </rng>
Nov 13 23:14:11 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:11 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:11 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:11 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:11 user nova-compute[75307]:   </devices>
Nov 13 23:14:11 user nova-compute[75307]: </domain>
Nov 13 23:14:11 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:11 user nova-compute[75307]: DEBUG os_vif [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Created schema index Interface.name {{(pid=75307) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Created schema index Port.name {{(pid=75307) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Created schema index Bridge.name {{(pid=75307) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [POLLOUT] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c85ed381-5f23-5e82-8706-361ec19d4164', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:12 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpspjff7yn/privsep.sock']
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Successfully updated port: e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:12 user sudo[84683]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpspjff7yn/privsep.sock
Nov 13 23:14:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:12 user sudo[84683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-changed-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Refreshing instance network info cache due to event network-changed-92e3832b-fb83-4ed1-8a9a-bc575a008b87. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance network_info: |[{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Refreshing network info cache for port 92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start _get_guest_xml network_info=[{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658784171',display_name='tempest-ServerRescueNegativeTestJSON-server-1658784171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658784171',id=2,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-d1rywi5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:06Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=11cd5b9d-7bb2-4492-8031-a9676c288140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:13 user nova-compute[75307]:   <uuid>11cd5b9d-7bb2-4492-8031-a9676c288140</uuid>
Nov 13 23:14:13 user nova-compute[75307]:   <name>instance-00000002</name>
Nov 13 23:14:13 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:13 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:13 user nova-compute[75307]:   <metadata>
Nov 13 23:14:13 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:13 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1658784171</nova:name>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:12</nova:creationTime>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:13 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:port uuid="92e3832b-fb83-4ed1-8a9a-bc575a008b87">
Nov 13 23:14:13 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:14:13 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:13 user nova-compute[75307]:   </metadata>
Nov 13 23:14:13 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:13 user nova-compute[75307]:     <system>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="serial">11cd5b9d-7bb2-4492-8031-a9676c288140</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="uuid">11cd5b9d-7bb2-4492-8031-a9676c288140</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:13 user nova-compute[75307]:     </system>
Nov 13 23:14:13 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:13 user nova-compute[75307]:   <os>
Nov 13 23:14:13 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:13 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:13 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:13 user nova-compute[75307]:   </os>
Nov 13 23:14:13 user nova-compute[75307]:   <features>
Nov 13 23:14:13 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:13 user nova-compute[75307]:     <apic/>
Nov 13 23:14:13 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:13 user nova-compute[75307]:   </features>
Nov 13 23:14:13 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:13 user nova-compute[75307]:   </clock>
Nov 13 23:14:13 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:13 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:13 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:13 user nova-compute[75307]:   </cpu>
Nov 13 23:14:13 user nova-compute[75307]:   <devices>
Nov 13 23:14:13 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:13 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:13 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </disk>
Nov 13 23:14:13 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:13 user nova-compute[75307]:       <mac address="fa:16:3e:a9:6b:e6"/>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="tap92e3832b-fb"/>
Nov 13 23:14:13 user nova-compute[75307]:     </interface>
Nov 13 23:14:13 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:13 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/console.log" append="off"/>
Nov 13 23:14:13 user nova-compute[75307]:     </serial>
Nov 13 23:14:13 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:     <video>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </video>
Nov 13 23:14:13 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:13 user nova-compute[75307]:     </rng>
Nov 13 23:14:13 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:13 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:13 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:13 user nova-compute[75307]:   </devices>
Nov 13 23:14:13 user nova-compute[75307]: </domain>
Nov 13 23:14:13 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658784171',display_name='tempest-ServerRescueNegativeTestJSON-server-1658784171',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658784171',id=2,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-d1rywi5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:06Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=11cd5b9d-7bb2-4492-8031-a9676c288140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG os_vif [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46f7aa98-d438-5376-9351-8708856ccf94', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating instance_info_cache with network_info: [{"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Releasing lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Instance network_info: |[{"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] Acquired lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Refreshing network info cache for port 5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Start _get_guest_xml network_info=[{"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-320323385',display_name='tempest-DeleteServersTestJSON-server-320323385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-320323385',id=1,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2a08b833bbe4103bed42ccb1d064846',ramdisk_id='',reservation_id='r-33wggj0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1666613041',owner_user_name='tempest-DeleteServersTestJSON-1666613041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:05Z,user_data=None,user_id='9c06379bf565487284e596dceed5d8f8',uuid=3fdb8e80-ade5-46d2-9d88-aa41d93c2a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converting VIF {"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:13 user nova-compute[75307]:   <uuid>3fdb8e80-ade5-46d2-9d88-aa41d93c2a60</uuid>
Nov 13 23:14:13 user nova-compute[75307]:   <name>instance-00000001</name>
Nov 13 23:14:13 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:13 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:13 user nova-compute[75307]:   <metadata>
Nov 13 23:14:13 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:13 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:name>tempest-DeleteServersTestJSON-server-320323385</nova:name>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:13</nova:creationTime>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:13 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:user uuid="9c06379bf565487284e596dceed5d8f8">tempest-DeleteServersTestJSON-1666613041-project-member</nova:user>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:project uuid="d2a08b833bbe4103bed42ccb1d064846">tempest-DeleteServersTestJSON-1666613041</nova:project>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:port uuid="5f82b533-de1e-4842-b541-7e0532d95fec">
Nov 13 23:14:13 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 23:14:13 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:13 user nova-compute[75307]:   </metadata>
Nov 13 23:14:13 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:13 user nova-compute[75307]:     <system>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="serial">3fdb8e80-ade5-46d2-9d88-aa41d93c2a60</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="uuid">3fdb8e80-ade5-46d2-9d88-aa41d93c2a60</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:13 user nova-compute[75307]:     </system>
Nov 13 23:14:13 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:13 user nova-compute[75307]:   <os>
Nov 13 23:14:13 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:13 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:13 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:13 user nova-compute[75307]:   </os>
Nov 13 23:14:13 user nova-compute[75307]:   <features>
Nov 13 23:14:13 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:13 user nova-compute[75307]:     <apic/>
Nov 13 23:14:13 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:13 user nova-compute[75307]:   </features>
Nov 13 23:14:13 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:13 user nova-compute[75307]:   </clock>
Nov 13 23:14:13 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:13 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:13 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:13 user nova-compute[75307]:   </cpu>
Nov 13 23:14:13 user nova-compute[75307]:   <devices>
Nov 13 23:14:13 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:13 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:13 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </disk>
Nov 13 23:14:13 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:13 user nova-compute[75307]:       <mac address="fa:16:3e:96:9b:c3"/>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="tap5f82b533-de"/>
Nov 13 23:14:13 user nova-compute[75307]:     </interface>
Nov 13 23:14:13 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:13 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/console.log" append="off"/>
Nov 13 23:14:13 user nova-compute[75307]:     </serial>
Nov 13 23:14:13 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:     <video>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </video>
Nov 13 23:14:13 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:13 user nova-compute[75307]:     </rng>
Nov 13 23:14:13 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:13 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:13 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:13 user nova-compute[75307]:   </devices>
Nov 13 23:14:13 user nova-compute[75307]: </domain>
Nov 13 23:14:13 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-320323385',display_name='tempest-DeleteServersTestJSON-server-320323385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-320323385',id=1,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2a08b833bbe4103bed42ccb1d064846',ramdisk_id='',reservation_id='r-33wggj0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1666613041',owner_user_name='tempest-DeleteServersTestJSON-1666613041-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:05Z,user_data=None,user_id='9c06379bf565487284e596dceed5d8f8',uuid=3fdb8e80-ade5-46d2-9d88-aa41d93c2a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converting VIF {"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG os_vif [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c811551d-d2d6-5092-94b7-4b3bde26775f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:13 user sudo[84683]: pam_unix(sudo:session): session closed for user root
Nov 13 23:14:13 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Spawned new privsep daemon via rootwrap
Nov 13 23:14:13 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 23:14:13 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 23:14:13 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 13 23:14:13 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84686
Nov 13 23:14:13 user nova-compute[75307]: WARNING oslo_privsep.priv_context [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] privsep daemon already running
Nov 13 23:14:13 user nova-compute[75307]: WARNING oslo_privsep.priv_context [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] privsep daemon already running
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance network_info: |[{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start _get_guest_xml network_info=[{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-540814245',display_name='tempest-ServerRescueNegativeTestJSON-server-540814245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-540814245',id=3,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-zop0x8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:07Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=7ce8bbfc-ee12-48b0-85a4-8c7680502e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.objects.instance [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:13 user nova-compute[75307]:   <uuid>7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</uuid>
Nov 13 23:14:13 user nova-compute[75307]:   <name>instance-00000003</name>
Nov 13 23:14:13 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:13 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:13 user nova-compute[75307]:   <metadata>
Nov 13 23:14:13 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:13 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-540814245</nova:name>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:13</nova:creationTime>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:13 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:13 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:         <nova:port uuid="e7b19d21-b8a1-40c4-a576-1ac4f4276c4d">
Nov 13 23:14:13 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 23:14:13 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:13 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:13 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:13 user nova-compute[75307]:   </metadata>
Nov 13 23:14:13 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:13 user nova-compute[75307]:     <system>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="serial">7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="uuid">7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</entry>
Nov 13 23:14:13 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:13 user nova-compute[75307]:     </system>
Nov 13 23:14:13 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:13 user nova-compute[75307]:   <os>
Nov 13 23:14:13 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:13 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:13 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:13 user nova-compute[75307]:   </os>
Nov 13 23:14:13 user nova-compute[75307]:   <features>
Nov 13 23:14:13 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:13 user nova-compute[75307]:     <apic/>
Nov 13 23:14:13 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:13 user nova-compute[75307]:   </features>
Nov 13 23:14:13 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:13 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:13 user nova-compute[75307]:   </clock>
Nov 13 23:14:13 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:13 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:13 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:13 user nova-compute[75307]:   </cpu>
Nov 13 23:14:13 user nova-compute[75307]:   <devices>
Nov 13 23:14:13 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:13 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:13 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </disk>
Nov 13 23:14:13 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:13 user nova-compute[75307]:       <mac address="fa:16:3e:f1:e9:5a"/>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:13 user nova-compute[75307]:       <target dev="tape7b19d21-b8"/>
Nov 13 23:14:13 user nova-compute[75307]:     </interface>
Nov 13 23:14:13 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:13 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/console.log" append="off"/>
Nov 13 23:14:13 user nova-compute[75307]:     </serial>
Nov 13 23:14:13 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:13 user nova-compute[75307]:     <video>
Nov 13 23:14:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:13 user nova-compute[75307]:     </video>
Nov 13 23:14:13 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:13 user nova-compute[75307]:     </rng>
Nov 13 23:14:13 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:13 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:13 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:13 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:13 user nova-compute[75307]:   </devices>
Nov 13 23:14:13 user nova-compute[75307]: </domain>
Nov 13 23:14:13 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-540814245',display_name='tempest-ServerRescueNegativeTestJSON-server-540814245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-540814245',id=3,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-zop0x8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:07Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=7ce8bbfc-ee12-48b0-85a4-8c7680502e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG os_vif [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f9224ae-7303-5e21-9c48-6f81ba1239f9', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updated VIF entry in instance network info cache for port d6511cea-1a73-4612-bd4b-5a50bd96a3b1. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbc4df3-8251-4895-bcf1-7ac7ce0fad32 req-41ae9189-3b79-49ca-b5be-6f1b8ac11064 service nova] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-changed-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Refreshing instance network info cache due to event network-changed-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Refreshing network info cache for port e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap92e3832b-fb, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap92e3832b-fb, col_values=(('qos', UUID('e1d2a1e9-ce60-4a5c-8cd8-af4909b81a8d')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap92e3832b-fb, col_values=(('external_ids', {'iface-id': '92e3832b-fb83-4ed1-8a9a-bc575a008b87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:6b:e6', 'vm-uuid': '11cd5b9d-7bb2-4492-8031-a9676c288140'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: INFO os_vif [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb')
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6511cea-1a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6511cea-1a, col_values=(('qos', UUID('887d58b7-3673-4b65-891f-963455df55da')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6511cea-1a, col_values=(('external_ids', {'iface-id': 'd6511cea-1a73-4612-bd4b-5a50bd96a3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:10:97', 'vm-uuid': 'fdc18eac-a300-4f89-8621-2075decfec01'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: INFO os_vif [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f82b533-de, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f82b533-de, col_values=(('qos', UUID('d9df6e00-9bb6-4789-9e2f-a51568630344')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f82b533-de, col_values=(('external_ids', {'iface-id': '5f82b533-de1e-4842-b541-7e0532d95fec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:9b:c3', 'vm-uuid': '3fdb8e80-ade5-46d2-9d88-aa41d93c2a60'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: INFO os_vif [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de')
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7b19d21-b8, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7b19d21-b8, col_values=(('qos', UUID('b98a77ce-5607-4c25-9646-2f960b6fdf1a')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7b19d21-b8, col_values=(('external_ids', {'iface-id': 'e7b19d21-b8a1-40c4-a576-1ac4f4276c4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:e9:5a', 'vm-uuid': '7ce8bbfc-ee12-48b0-85a4-8c7680502e6d'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updated VIF entry in instance network info cache for port 92e3832b-fb83-4ed1-8a9a-bc575a008b87. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:14 user nova-compute[75307]: INFO os_vif [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8')
Nov 13 23:14:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a6ac808b-a383-4a4e-bcc1-68162eeb546d req-2afceffa-d88e-45f3-ac0a-d51684710462 service nova] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:a9:6b:e6, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No VIF found with MAC fa:16:3e:7a:10:97, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] No VIF found with MAC fa:16:3e:96:9b:c3, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:f1:e9:5a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updated VIF entry in instance network info cache for port 5f82b533-de1e-4842-b541-7e0532d95fec. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating instance_info_cache with network_info: [{"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76e8f50a-c528-4dd4-9612-5eca45cc144d req-e85556aa-64e1-4810-b7c6-f2613cf1b4f6 service nova] Releasing lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:15 user nova-compute[75307]: DEBUG nova.network.neutron [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updated VIF entry in instance network info cache for port e7b19d21-b8a1-40c4-a576-1ac4f4276c4d. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:15 user nova-compute[75307]: DEBUG nova.network.neutron [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b170cdab-7bf7-4dcc-a205-1bbad3e17ca8 req-f049b8b7-410a-4028-9732-602598607137 service nova] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:20 user nova-compute[75307]: WARNING nova.compute.manager [req-88a46ce2-8904-4b1a-a407-9835bc90ea45 req-dc1fccd4-2bb1-4597-aaa2-3a2fb8231052 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state building and task_state spawning.
Nov 13 23:14:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:22 user nova-compute[75307]: WARNING nova.compute.manager [req-51aa5e13-46a2-4dc3-9393-19152ea4f248 req-cd8610e6-8248-46c1-97e1-fbb3bc54c38e service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state building and task_state spawning.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Instance spawned successfully.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance spawned successfully.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance spawned successfully.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance spawned successfully.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Took 17.32 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Took 16.02 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Took 15.75 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Took 16.44 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:22 user nova-compute[75307]: INFO nova.compute.manager [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Took 18.67 seconds to build instance.
Nov 13 23:14:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6a046cd3-682d-4c39-9c65-252d777440b6 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.899s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:23 user nova-compute[75307]: INFO nova.compute.manager [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Took 17.57 seconds to build instance.
Nov 13 23:14:23 user nova-compute[75307]: INFO nova.compute.manager [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Took 16.91 seconds to build instance.
Nov 13 23:14:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5b6ed51a-8092-4f27-8a70-f2eee0586db2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.708s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:23 user nova-compute[75307]: INFO nova.compute.manager [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Took 18.03 seconds to build instance.
Nov 13 23:14:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4f8bf8c9-4d11-4875-8857-2c8a564d4a78 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.180s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec00340f-d528-44d3-bc0b-ee75b9384fe7 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.184s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:27 user nova-compute[75307]: INFO nova.compute.claims [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Claim successful on node user
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.760s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG nova.policy [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6962721fd5104239bdd55f20fd7dc702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6bf881a2474024a7f84cc5b93d440e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Creating image(s)
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "/opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "/opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.357s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:28 user nova-compute[75307]: INFO nova.compute.claims [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Claim successful on node user
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.336s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk 1073741824" returned: 0 in 0.096s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.440s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.349s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.918s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.213s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:29 user nova-compute[75307]: INFO nova.compute.claims [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Claim successful on node user
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.388s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Cannot resize image /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Ensure instance console log exists: /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.014s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.policy [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1395b52398a14f21933e00866ee52ad8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f06c812f7eb14d6787f160b2c9e0c7f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:30 user nova-compute[75307]: INFO nova.virt.block_device [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Booting with volume bb0cf1e3-92ed-43bd-902d-617253af6522 at /dev/vda
Nov 13 23:14:30 user nova-compute[75307]: DEBUG os_brick.utils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:14:30 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpz8godqdd/privsep.sock']
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:30 user sudo[85223]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpz8godqdd/privsep.sock
Nov 13 23:14:30 user sudo[85223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.940s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG nova.policy [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ade1329f384250a9d4bfb46663af88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb004021b8aa4795b049ebad0d119f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Creating image(s)
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Successfully created port: 3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.357s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Successfully created port: dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.281s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk 1073741824" returned: 0 in 0.065s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.352s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.213s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Cannot resize image /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Ensure instance console log exists: /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:33 user sudo[85223]: pam_unix(sudo:session): session closed for user root
Nov 13 23:14:33 user nova-compute[75307]: INFO oslo.privsep.daemon [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Spawned new privsep daemon via rootwrap
Nov 13 23:14:33 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 13 23:14:33 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 13 23:14:33 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 13 23:14:33 user nova-compute[75307]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85241
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ebf0eb-3cd5-4be3-8430-db161bc3af06]: (2,) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Successfully updated port: 3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Successfully created port: fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:33 user nova-compute[75307]: INFO nova.compute.claims [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Claim successful on node user
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquired lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-changed-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Refreshing instance network info cache due to event network-changed-3328c69f-165f-461b-93c1-20059eb97c33. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] Acquiring lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d023ea9-90eb-49e1-988e-d2e2665d7edb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: WARNING os_brick.initiator.connectors.nvmeof [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcad64f-7aa8-4f42-b45e-0ede89d03bb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1526bd3-f3f5-4e9c-8a35-b57622253b34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa59ed3-ad69-47e6-828c-d99671c9dc22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:33 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d74f7-48f1-4c20-9cb1-3b0a87897354]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG os_brick.utils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== get_connector_properties: return (3016ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating existing volume attachment record: 6ef1c08e-e647-4907-9b86-ce9fade6b79b {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Successfully updated port: dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquired lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-changed-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Refreshing instance network info cache due to event network-changed-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] Acquiring lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.980s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Successfully updated port: fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-changed-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing instance network info cache due to event network-changed-fb7cdb1d-f098-4652-af97-d7ad34850018. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.policy [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3fde426ad9b54386a28de0134432dd2a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd10327c6a1ac43608e69263beb3417c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Creating image(s)
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating instance_info_cache with network_info: [{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating instance_info_cache with network_info: [{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Releasing lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Instance network_info: |[{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] Acquired lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Refreshing network info cache for port 3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Start _get_guest_xml network_info=[{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Releasing lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance network_info: |[{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] Acquired lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Refreshing network info cache for port dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797842599',display_name='tempest-VolumesAdminNegativeTest-server-797842599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797842599',id=5,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVIKZMmBNJO2bT9Sy2yRNscA3mHIVdmnRjIS3OPDjBv0uFuYod24FVjhdOj+m5JJrWsx105V2awBrcnhKVyOeRYAP90Sd/H8//hI1Noej1IT5ovxiTXi3xSjWdxWaxKA==',key_name='tempest-keypair-108270061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-tiafzhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6962721fd5104239bdd55f20fd7dc702',uuid=ea05ed6f-d9fa-4393-beb6-569f50defea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'pci_devices' on Instance uuid ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.part --force-share --output=json" returned: 0 in 0.275s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.images [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] b3db46b7-6a01-4754-b9c1-df6d1988ef05 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.part /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:35 user nova-compute[75307]:   <uuid>ea05ed6f-d9fa-4393-beb6-569f50defea6</uuid>
Nov 13 23:14:35 user nova-compute[75307]:   <name>instance-00000005</name>
Nov 13 23:14:35 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:35 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:35 user nova-compute[75307]:   <metadata>
Nov 13 23:14:35 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:35 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:name>tempest-VolumesAdminNegativeTest-server-797842599</nova:name>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:35</nova:creationTime>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:35 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:user uuid="6962721fd5104239bdd55f20fd7dc702">tempest-VolumesAdminNegativeTest-265333520-project-member</nova:user>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:project uuid="aa6bf881a2474024a7f84cc5b93d440e">tempest-VolumesAdminNegativeTest-265333520</nova:project>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:port uuid="3328c69f-165f-461b-93c1-20059eb97c33">
Nov 13 23:14:35 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:14:35 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:35 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:35 user nova-compute[75307]:   </metadata>
Nov 13 23:14:35 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:35 user nova-compute[75307]:     <system>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="serial">ea05ed6f-d9fa-4393-beb6-569f50defea6</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="uuid">ea05ed6f-d9fa-4393-beb6-569f50defea6</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:35 user nova-compute[75307]:     </system>
Nov 13 23:14:35 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:35 user nova-compute[75307]:   <os>
Nov 13 23:14:35 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:35 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:35 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:35 user nova-compute[75307]:   </os>
Nov 13 23:14:35 user nova-compute[75307]:   <features>
Nov 13 23:14:35 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:35 user nova-compute[75307]:     <apic/>
Nov 13 23:14:35 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:35 user nova-compute[75307]:   </features>
Nov 13 23:14:35 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:35 user nova-compute[75307]:   </clock>
Nov 13 23:14:35 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:35 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:35 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:35 user nova-compute[75307]:   </cpu>
Nov 13 23:14:35 user nova-compute[75307]:   <devices>
Nov 13 23:14:35 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:35 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:35 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk"/>
Nov 13 23:14:35 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:     </disk>
Nov 13 23:14:35 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:35 user nova-compute[75307]:       <mac address="fa:16:3e:40:ca:4a"/>
Nov 13 23:14:35 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:35 user nova-compute[75307]:       <target dev="tap3328c69f-16"/>
Nov 13 23:14:35 user nova-compute[75307]:     </interface>
Nov 13 23:14:35 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:35 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/console.log" append="off"/>
Nov 13 23:14:35 user nova-compute[75307]:     </serial>
Nov 13 23:14:35 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:35 user nova-compute[75307]:     <video>
Nov 13 23:14:35 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:     </video>
Nov 13 23:14:35 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:35 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:35 user nova-compute[75307]:     </rng>
Nov 13 23:14:35 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:35 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:35 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:35 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:35 user nova-compute[75307]:   </devices>
Nov 13 23:14:35 user nova-compute[75307]: </domain>
Nov 13 23:14:35 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797842599',display_name='tempest-VolumesAdminNegativeTest-server-797842599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797842599',id=5,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVIKZMmBNJO2bT9Sy2yRNscA3mHIVdmnRjIS3OPDjBv0uFuYod24FVjhdOj+m5JJrWsx105V2awBrcnhKVyOeRYAP90Sd/H8//hI1Noej1IT5ovxiTXi3xSjWdxWaxKA==',key_name='tempest-keypair-108270061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-tiafzhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6962721fd5104239bdd55f20fd7dc702',uuid=ea05ed6f-d9fa-4393-beb6-569f50defea6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG os_vif [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Instance network_info: |[{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.neutron [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing network info cache for port fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Start _get_guest_xml network_info=[{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b49a4ad-3dfc-5fff-937b-b63279447d25', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3328c69f-16, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3328c69f-16, col_values=(('qos', UUID('d6fde78d-a534-4f48-83b2-613c3c15718c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3328c69f-16, col_values=(('external_ids', {'iface-id': '3328c69f-165f-461b-93c1-20059eb97c33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:ca:4a', 'vm-uuid': 'ea05ed6f-d9fa-4393-beb6-569f50defea6'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:35 user nova-compute[75307]:   <uuid>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</uuid>
Nov 13 23:14:35 user nova-compute[75307]:   <name>instance-00000007</name>
Nov 13 23:14:35 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:35 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:35 user nova-compute[75307]:   <metadata>
Nov 13 23:14:35 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:35 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:35</nova:creationTime>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:35 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:35 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:35 user nova-compute[75307]:         <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:14:35 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:14:35 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:35 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:35 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:35 user nova-compute[75307]:   </metadata>
Nov 13 23:14:35 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:35 user nova-compute[75307]:     <system>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="serial">9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="uuid">9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:14:35 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:35 user nova-compute[75307]:     </system>
Nov 13 23:14:35 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:35 user nova-compute[75307]:   <os>
Nov 13 23:14:35 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:35 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:35 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:35 user nova-compute[75307]:   </os>
Nov 13 23:14:35 user nova-compute[75307]:   <features>
Nov 13 23:14:35 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:35 user nova-compute[75307]:     <apic/>
Nov 13 23:14:35 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:35 user nova-compute[75307]:   </features>
Nov 13 23:14:35 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:35 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:35 user nova-compute[75307]:   </clock>
Nov 13 23:14:35 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:35 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:35 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:35 user nova-compute[75307]:   </cpu>
Nov 13 23:14:35 user nova-compute[75307]:   <devices>
Nov 13 23:14:35 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:35 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:35 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk"/>
Nov 13 23:14:35 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:     </disk>
Nov 13 23:14:35 user nova-compute[75307]:     <disk type="file" device="cdrom">
Nov 13 23:14:35 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 23:14:35 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config"/>
Nov 13 23:14:35 user nova-compute[75307]:       <target dev="hda" bus="ide"/>
Nov 13 23:14:35 user nova-compute[75307]:     </disk>
Nov 13 23:14:35 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:35 user nova-compute[75307]:       <mac address="fa:16:3e:8a:94:82"/>
Nov 13 23:14:35 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:35 user nova-compute[75307]:       <target dev="tapfb7cdb1d-f0"/>
Nov 13 23:14:35 user nova-compute[75307]:     </interface>
Nov 13 23:14:35 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:35 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log" append="off"/>
Nov 13 23:14:35 user nova-compute[75307]:     </serial>
Nov 13 23:14:35 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:35 user nova-compute[75307]:     <video>
Nov 13 23:14:35 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:35 user nova-compute[75307]:     </video>
Nov 13 23:14:35 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:35 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:35 user nova-compute[75307]:     </rng>
Nov 13 23:14:35 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:35 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:35 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:35 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:35 user nova-compute[75307]:   </devices>
Nov 13 23:14:35 user nova-compute[75307]: </domain>
Nov 13 23:14:35 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG os_vif [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: INFO os_vif [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16')
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd42c6cc1-dc1e-56c7-bcff-23d311d5011c', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfb7cdb1d-f0, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfb7cdb1d-f0, col_values=(('qos', UUID('68f36ebb-2e09-45c0-a4f8-96a4d776edb5')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfb7cdb1d-f0, col_values=(('external_ids', {'iface-id': 'fb7cdb1d-f098-4652-af97-d7ad34850018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:94:82', 'vm-uuid': '9ad3fd32-a8f8-48aa-a198-13bd6bf20caa'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:35 user nova-compute[75307]: INFO os_vif [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0')
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.part /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.converted" returned: 0 in 0.371s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No VIF found with MAC fa:16:3e:40:ca:4a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name hda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No VIF found with MAC fa:16:3e:8a:94:82, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Using config drive
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:36 user nova-compute[75307]: WARNING nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state None.
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:36 user nova-compute[75307]: WARNING nova.compute.manager [req-2cad9645-aa31-4626-8cb5-74dea660b3e2 req-969d8a5b-6ca9-4aa2-9eb9-1543751a7acd service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state None.
Nov 13 23:14:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca.converted --force-share --output=json" returned: 0 in 0.280s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.512s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json" returned: 0 in 0.306s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updated VIF entry in instance network info cache for port fb7cdb1d-f098-4652-af97-d7ad34850018. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json" returned: 0 in 0.219s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db04b8d2-3324-447d-9317-965d2d7025d4 req-249ac4cb-9c03-45e1-b88e-0e12096afb57 service nova] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca,backing_fmt=raw /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca,backing_fmt=raw /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk 1073741824" returned: 0 in 0.121s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "3116d51acfae17d0c7b98f826374a1bfb8b6dfca" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updated VIF entry in instance network info cache for port dd6f1e80-dce1-4984-9458-d1dd8cd0cab2. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating instance_info_cache with network_info: [{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e701c7-9d45-425e-8d61-796ef177c541 req-6424b6c2-1a13-46ca-8b8b-52aa66c8979b service nova] Releasing lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Successfully created port: 0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Creating config drive at /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg2rjii2e {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updated VIF entry in instance network info cache for port 3328c69f-165f-461b-93c1-20059eb97c33. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating instance_info_cache with network_info: [{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca --force-share --output=json" returned: 0 in 0.499s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpg2rjii2e" returned: 0 in 0.138s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76b4ff0f-58f7-46ee-b478-13a816b850f7 req-e45e1e2e-f901-46c8-bb51-442f0a23d8d2 service nova] Releasing lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Cannot resize image /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Ensure instance console log exists: /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Successfully updated port: 0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquired lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-changed-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Refreshing instance network info cache due to event network-changed-0afdfdfa-53d3-46a5-90ad-d65ec1547664. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] Acquiring lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.neutron [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updating instance_info_cache with network_info: [{"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Releasing lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Instance network_info: |[{"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] Acquired lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.neutron [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Refreshing network info cache for port 0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Start _get_guest_xml network_info=[{"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:14:21Z,direct_url=<?>,disk_format='qcow2',id=b3db46b7-6a01-4754-b9c1-df6d1988ef05,min_disk=0,min_ram=0,name='',owner='8f922db3c8ad4274871473476fd8a55f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:14:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'scsi', 'image_id': 'b3db46b7-6a01-4754-b9c1-df6d1988ef05'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:14:21Z,direct_url=<?>,disk_format='qcow2',id=b3db46b7-6a01-4754-b9c1-df6d1988ef05,min_disk=0,min_ram=0,name='',owner='8f922db3c8ad4274871473476fd8a55f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:14:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-659387937',display_name='tempest-AttachSCSIVolumeTestJSON-server-659387937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-659387937',id=8,image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8tSEnT716c/sdEIR58zOwBiNyZ3Wu+FxeBfLEsOK/Ev0Yx+sdV1c6E1HBWjnQA+RGxwodGyS/8LxRqCSL9VvdL2vmVHIr5aKSmw7869t7ssL094GxtLHwN5iJ6wW29Gg==',key_name='tempest-keypair-301741751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d10327c6a1ac43608e69263beb3417c2',ramdisk_id='',reservation_id='r-xwzi8vpb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1302229424',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1302229424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fde426ad9b54386a28de0134432dd2a',uuid=0f67a3a3-418a-4287-b639-8b285caaf4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converting VIF {"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lazy-loading 'pci_devices' on Instance uuid 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:39 user nova-compute[75307]:   <uuid>0f67a3a3-418a-4287-b639-8b285caaf4ec</uuid>
Nov 13 23:14:39 user nova-compute[75307]:   <name>instance-00000008</name>
Nov 13 23:14:39 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:39 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:39 user nova-compute[75307]:   <metadata>
Nov 13 23:14:39 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:39 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-659387937</nova:name>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:39</nova:creationTime>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:39 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:39 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:user uuid="3fde426ad9b54386a28de0134432dd2a">tempest-AttachSCSIVolumeTestJSON-1302229424-project-member</nova:user>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:project uuid="d10327c6a1ac43608e69263beb3417c2">tempest-AttachSCSIVolumeTestJSON-1302229424</nova:project>
Nov 13 23:14:39 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:root type="image" uuid="b3db46b7-6a01-4754-b9c1-df6d1988ef05"/>
Nov 13 23:14:39 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:39 user nova-compute[75307]:         <nova:port uuid="0afdfdfa-53d3-46a5-90ad-d65ec1547664">
Nov 13 23:14:39 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 23:14:39 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:39 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:39 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:39 user nova-compute[75307]:   </metadata>
Nov 13 23:14:39 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:39 user nova-compute[75307]:     <system>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="serial">0f67a3a3-418a-4287-b639-8b285caaf4ec</entry>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="uuid">0f67a3a3-418a-4287-b639-8b285caaf4ec</entry>
Nov 13 23:14:39 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:39 user nova-compute[75307]:     </system>
Nov 13 23:14:39 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:39 user nova-compute[75307]:   <os>
Nov 13 23:14:39 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:39 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:39 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:39 user nova-compute[75307]:   </os>
Nov 13 23:14:39 user nova-compute[75307]:   <features>
Nov 13 23:14:39 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:39 user nova-compute[75307]:     <apic/>
Nov 13 23:14:39 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:39 user nova-compute[75307]:   </features>
Nov 13 23:14:39 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:39 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:39 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:39 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:39 user nova-compute[75307]:   </clock>
Nov 13 23:14:39 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:39 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:39 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:39 user nova-compute[75307]:   </cpu>
Nov 13 23:14:39 user nova-compute[75307]:   <devices>
Nov 13 23:14:39 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:39 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:39 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk"/>
Nov 13 23:14:39 user nova-compute[75307]:       <target dev="sda" bus="scsi"/>
Nov 13 23:14:39 user nova-compute[75307]:       <address type="drive" controller="0" unit="0"/>
Nov 13 23:14:39 user nova-compute[75307]:     </disk>
Nov 13 23:14:39 user nova-compute[75307]:     <disk type="file" device="cdrom">
Nov 13 23:14:39 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 23:14:39 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.config"/>
Nov 13 23:14:39 user nova-compute[75307]:       <target dev="sdb" bus="scsi"/>
Nov 13 23:14:39 user nova-compute[75307]:       <address type="drive" controller="0" unit="1"/>
Nov 13 23:14:39 user nova-compute[75307]:     </disk>
Nov 13 23:14:39 user nova-compute[75307]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 13 23:14:39 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:39 user nova-compute[75307]:       <mac address="fa:16:3e:c6:ff:eb"/>
Nov 13 23:14:39 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:39 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:39 user nova-compute[75307]:       <target dev="tap0afdfdfa-53"/>
Nov 13 23:14:39 user nova-compute[75307]:     </interface>
Nov 13 23:14:39 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:39 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/console.log" append="off"/>
Nov 13 23:14:39 user nova-compute[75307]:     </serial>
Nov 13 23:14:39 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:39 user nova-compute[75307]:     <video>
Nov 13 23:14:39 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:39 user nova-compute[75307]:     </video>
Nov 13 23:14:39 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:39 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:39 user nova-compute[75307]:     </rng>
Nov 13 23:14:39 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:39 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:39 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:39 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:39 user nova-compute[75307]:   </devices>
Nov 13 23:14:39 user nova-compute[75307]: </domain>
Nov 13 23:14:39 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-659387937',display_name='tempest-AttachSCSIVolumeTestJSON-server-659387937',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-659387937',id=8,image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8tSEnT716c/sdEIR58zOwBiNyZ3Wu+FxeBfLEsOK/Ev0Yx+sdV1c6E1HBWjnQA+RGxwodGyS/8LxRqCSL9VvdL2vmVHIr5aKSmw7869t7ssL094GxtLHwN5iJ6wW29Gg==',key_name='tempest-keypair-301741751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d10327c6a1ac43608e69263beb3417c2',ramdisk_id='',reservation_id='r-xwzi8vpb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1302229424',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1302229424-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fde426ad9b54386a28de0134432dd2a',uuid=0f67a3a3-418a-4287-b639-8b285caaf4ec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converting VIF {"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG os_vif [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5775b9b8-f80c-507f-ad08-719e7f6f0ef4', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0afdfdfa-53, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0afdfdfa-53, col_values=(('qos', UUID('fb603688-b114-48d3-a179-e9abaa6f3b23')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0afdfdfa-53, col_values=(('external_ids', {'iface-id': '0afdfdfa-53d3-46a5-90ad-d65ec1547664', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c6:ff:eb', 'vm-uuid': '0f67a3a3-418a-4287-b639-8b285caaf4ec'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: INFO os_vif [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53')
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No BDM found with device name sda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No VIF found with MAC fa:16:3e:c6:ff:eb, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:39 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Using config drive
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:39 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Creating config drive at /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.config
Nov 13 23:14:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp53_1maxu {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp53_1maxu" returned: 0 in 0.070s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.network.neutron [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updated VIF entry in instance network info cache for port 0afdfdfa-53d3-46a5-90ad-d65ec1547664. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.network.neutron [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updating instance_info_cache with network_info: [{"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-19c36272-236e-448b-b006-b053d1248fc4 req-41d85562-9980-495b-8640-960515e34e85 service nova] Releasing lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:40 user nova-compute[75307]: WARNING nova.compute.manager [req-0dd137b2-5413-467e-a485-5f2d97e9cd98 req-d52046cb-586d-4a6b-9a3e-85f50c3411c1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 for instance with vm_state building and task_state spawning.
Nov 13 23:14:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Creating image(s)
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Ensure instance console log exists: /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start _get_guest_xml network_info=[{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f700766b-4cb7-4eb9-a0b4-62e2c9c33a77', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb0cf1e3-92ed-43bd-902d-617253af6522', 'serial': 'bb0cf1e3-92ed-43bd-902d-617253af6522'}, 'delete_on_termination': True, 'attachment_id': '6ef1c08e-e647-4907-9b86-ce9fade6b79b', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connector [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Factory for ISCSI on None {{(pid=75307) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:14:40 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:14:40 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:14:40 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89d2c0-d4d7-4e86-8c60-8dc9494b80b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:14:40 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e8a0d1-601d-4034-a8fb-8f54e636276d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522] added
Nov 13 23:14:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aaca25-e277-4017-87ab-6b6697c95097]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1876e-3434-4046-9545-5dd1e05782ff]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeFrUcYt {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeFrUcYt" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4435ad1-58b6-4393-95dd-775204ce71de]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeFrUcYt'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8183b9-8cfc-4db8-9f09-23e4987c02b0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d320f8d-7522-4770-9541-4a61a0e3f9d3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 13 23:14:41 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 13 23:14:41 user nova-compute[75307]:  {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:14:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 13 23:14:41 user nova-compute[75307]: 
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb429b8-b6db-477c-92b9-050de2f5a48c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]
Nov 13 23:14:41 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.
Nov 13 23:14:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[673c7382-cc14-48a5-9e0d-ff6e7b2dfebc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2291b0d1-ad1c-4898-b453-e13d512f95fc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:14:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:14:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d616fd9-5ed5-4c28-92f1-e311853e8e31]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.compute.manager [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.compute.manager [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] No waiting events found dispatching network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:41 user nova-compute[75307]: WARNING nova.compute.manager [req-684b5be7-3635-4b4a-84c9-c9561dac0da8 req-cf579ed5-d974-41c5-a6da-6f927535a661 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received unexpected event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 for instance with vm_state building and task_state spawning.
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Instance spawned successfully.
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:42 user nova-compute[75307]: INFO nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Took 13.81 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:42 user nova-compute[75307]: INFO nova.compute.manager [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Took 15.25 seconds to build instance.
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4e4fc0f2-33c4-45ce-bb5a-07ff97e3c316 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.449s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== connect_volume: return (1362ms) {'type': 'block', 'scsi_wwn': '26561623862653431', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561623862653431', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-732987275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.objects.instance [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lazy-loading 'pci_devices' on Instance uuid f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:42 user nova-compute[75307]:   <uuid>f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</uuid>
Nov 13 23:14:42 user nova-compute[75307]:   <name>instance-00000006</name>
Nov 13 23:14:42 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:42 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:42 user nova-compute[75307]:   <metadata>
Nov 13 23:14:42 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:42 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:42 user nova-compute[75307]:       <nova:name>tempest-ServerActionsV293TestJSON-server-732987275</nova:name>
Nov 13 23:14:42 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:40</nova:creationTime>
Nov 13 23:14:42 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:42 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:42 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:42 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:user uuid="1395b52398a14f21933e00866ee52ad8">tempest-ServerActionsV293TestJSON-1262901442-project-member</nova:user>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:project uuid="f06c812f7eb14d6787f160b2c9e0c7f8">tempest-ServerActionsV293TestJSON-1262901442</nova:project>
Nov 13 23:14:42 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:42 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:42 user nova-compute[75307]:         <nova:port uuid="dd6f1e80-dce1-4984-9458-d1dd8cd0cab2">
Nov 13 23:14:42 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:14:42 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:42 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:42 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:42 user nova-compute[75307]:   </metadata>
Nov 13 23:14:42 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:42 user nova-compute[75307]:     <system>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="serial">f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</entry>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="uuid">f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</entry>
Nov 13 23:14:42 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:42 user nova-compute[75307]:     </system>
Nov 13 23:14:42 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:42 user nova-compute[75307]:   <os>
Nov 13 23:14:42 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:42 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:42 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:42 user nova-compute[75307]:   </os>
Nov 13 23:14:42 user nova-compute[75307]:   <features>
Nov 13 23:14:42 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:42 user nova-compute[75307]:     <apic/>
Nov 13 23:14:42 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:42 user nova-compute[75307]:   </features>
Nov 13 23:14:42 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:42 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:42 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:42 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:42 user nova-compute[75307]:   </clock>
Nov 13 23:14:42 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:42 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:42 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:42 user nova-compute[75307]:   </cpu>
Nov 13 23:14:42 user nova-compute[75307]:   <devices>
Nov 13 23:14:42 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:14:42 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:14:42 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:14:42 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:42 user nova-compute[75307]:       <serial>bb0cf1e3-92ed-43bd-902d-617253af6522</serial>
Nov 13 23:14:42 user nova-compute[75307]:     </disk>
Nov 13 23:14:42 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:42 user nova-compute[75307]:       <mac address="fa:16:3e:73:43:d1"/>
Nov 13 23:14:42 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:42 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:42 user nova-compute[75307]:       <target dev="tapdd6f1e80-dc"/>
Nov 13 23:14:42 user nova-compute[75307]:     </interface>
Nov 13 23:14:42 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:42 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77/console.log" append="off"/>
Nov 13 23:14:42 user nova-compute[75307]:     </serial>
Nov 13 23:14:42 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:42 user nova-compute[75307]:     <video>
Nov 13 23:14:42 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:42 user nova-compute[75307]:     </video>
Nov 13 23:14:42 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:42 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:42 user nova-compute[75307]:     </rng>
Nov 13 23:14:42 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:42 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:42 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:42 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:42 user nova-compute[75307]:   </devices>
Nov 13 23:14:42 user nova-compute[75307]: </domain>
Nov 13 23:14:42 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-732987275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG os_vif [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '215f5ff7-41b8-569e-ba1e-7e4346cb897f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd6f1e80-dc, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd6f1e80-dc, col_values=(('qos', UUID('6e3658d5-11dd-4ae2-86ff-0f9b05975bec')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd6f1e80-dc, col_values=(('external_ids', {'iface-id': 'dd6f1e80-dce1-4984-9458-d1dd8cd0cab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:43:d1', 'vm-uuid': 'f700766b-4cb7-4eb9-a0b4-62e2c9c33a77'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:42 user nova-compute[75307]: INFO os_vif [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc')
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] No VIF found with MAC fa:16:3e:73:43:d1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:42 user nova-compute[75307]: WARNING nova.compute.manager [req-e5b7e54d-9b0e-4cdb-9e9e-5de6a20cdbff req-95ca9101-beab-4809-9614-0a6c1c8e373c service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 for instance with vm_state building and task_state spawning.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.compute.claims [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Claim successful on node user
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Instance spawned successfully.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Took 12.35 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.compute.manager [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Took 14.15 seconds to build instance.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c515e357-7827-4e5b-bd9c-59b800894f40 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.425s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] No waiting events found dispatching network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:43 user nova-compute[75307]: WARNING nova.compute.manager [req-009abbfc-0ce4-4ff8-9b5e-42f2fbe8e488 req-37c3a21f-331f-4da7-9aa1-c432bc6be4ba service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received unexpected event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 for instance with vm_state building and task_state spawning.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Instance spawned successfully.
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG nova.policy [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5e011923791740f786db97bbb6df72b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4bf67291c7c44e33b44c9cfdf765b794', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:14:44 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Creating image(s)
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "/opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "/opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "/opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:44 user nova-compute[75307]: INFO nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Took 9.50 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:44 user nova-compute[75307]: INFO nova.compute.manager [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Took 11.19 seconds to build instance.
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-10955b51-5368-4f24-b0b5-87e3906ba8e7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.355s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.233s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.292s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk 1073741824" returned: 0 in 0.112s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.412s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Cannot resize image /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Ensure instance console log exists: /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:45 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Successfully created port: 800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No waiting events found dispatching network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:46 user nova-compute[75307]: WARNING nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state building and task_state spawning.
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No waiting events found dispatching network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:46 user nova-compute[75307]: WARNING nova.compute.manager [req-1f40c975-c05c-47a8-af14-d27bb0da0e45 req-9934aff4-bd07-4bf1-9a24-37402c4b3435 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state building and task_state spawning.
Nov 13 23:14:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Successfully updated port: 800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquired lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance spawned successfully.
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:47 user nova-compute[75307]: INFO nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating instance_info_cache with network_info: [{"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Releasing lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Instance network_info: |[{"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:14:47 user nova-compute[75307]: INFO nova.compute.manager [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Took 18.30 seconds to build instance.
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Start _get_guest_xml network_info=[{"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:14:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:14:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01f7fda9-f2f3-4a21-aafe-8cb940d3a3c9 tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.450s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-485170644',display_name='tempest-VolumesAssistedSnapshotsTest-server-485170644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-485170644',id=9,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkEOn8LipOSoXDVlFPK1HYi9pBEu5pJtuCIusBUEV3LXOI05dJsQ2P8EFSu35bdQ/w+DXxzhgMA4yYH79WNw0knWrJVbuT4SmQMmEOqQRY5cGXq9kNjCWvExaaHLyj4kg==',key_name='tempest-keypair-1574687254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bf67291c7c44e33b44c9cfdf765b794',ramdisk_id='',reservation_id='r-mlvwqhn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1068930723',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1068930723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e011923791740f786db97bbb6df72b5',uuid=e1e6da31-8158-4824-956b-c3f619dd06b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converting VIF {"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lazy-loading 'pci_devices' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:14:47 user nova-compute[75307]:   <uuid>e1e6da31-8158-4824-956b-c3f619dd06b4</uuid>
Nov 13 23:14:47 user nova-compute[75307]:   <name>instance-00000009</name>
Nov 13 23:14:47 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:14:47 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:14:47 user nova-compute[75307]:   <metadata>
Nov 13 23:14:47 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:14:47 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-485170644</nova:name>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:14:47</nova:creationTime>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:14:47 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:14:47 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:owner>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:user uuid="5e011923791740f786db97bbb6df72b5">tempest-VolumesAssistedSnapshotsTest-1068930723-project-member</nova:user>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:project uuid="4bf67291c7c44e33b44c9cfdf765b794">tempest-VolumesAssistedSnapshotsTest-1068930723</nova:project>
Nov 13 23:14:47 user nova-compute[75307]:       </nova:owner>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:14:47 user nova-compute[75307]:       <nova:ports>
Nov 13 23:14:47 user nova-compute[75307]:         <nova:port uuid="800034b9-e021-423d-baea-389a08093ef6">
Nov 13 23:14:47 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:14:47 user nova-compute[75307]:         </nova:port>
Nov 13 23:14:47 user nova-compute[75307]:       </nova:ports>
Nov 13 23:14:47 user nova-compute[75307]:     </nova:instance>
Nov 13 23:14:47 user nova-compute[75307]:   </metadata>
Nov 13 23:14:47 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:14:47 user nova-compute[75307]:     <system>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="serial">e1e6da31-8158-4824-956b-c3f619dd06b4</entry>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="uuid">e1e6da31-8158-4824-956b-c3f619dd06b4</entry>
Nov 13 23:14:47 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:14:47 user nova-compute[75307]:     </system>
Nov 13 23:14:47 user nova-compute[75307]:   </sysinfo>
Nov 13 23:14:47 user nova-compute[75307]:   <os>
Nov 13 23:14:47 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:14:47 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:14:47 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:14:47 user nova-compute[75307]:   </os>
Nov 13 23:14:47 user nova-compute[75307]:   <features>
Nov 13 23:14:47 user nova-compute[75307]:     <acpi/>
Nov 13 23:14:47 user nova-compute[75307]:     <apic/>
Nov 13 23:14:47 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:14:47 user nova-compute[75307]:   </features>
Nov 13 23:14:47 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:14:47 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:14:47 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:14:47 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:14:47 user nova-compute[75307]:   </clock>
Nov 13 23:14:47 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:14:47 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:14:47 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:14:47 user nova-compute[75307]:   </cpu>
Nov 13 23:14:47 user nova-compute[75307]:   <devices>
Nov 13 23:14:47 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:14:47 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:14:47 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk"/>
Nov 13 23:14:47 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:14:47 user nova-compute[75307]:     </disk>
Nov 13 23:14:47 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:14:47 user nova-compute[75307]:       <mac address="fa:16:3e:cc:6a:6c"/>
Nov 13 23:14:47 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:47 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:14:47 user nova-compute[75307]:       <target dev="tap800034b9-e0"/>
Nov 13 23:14:47 user nova-compute[75307]:     </interface>
Nov 13 23:14:47 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:14:47 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/console.log" append="off"/>
Nov 13 23:14:47 user nova-compute[75307]:     </serial>
Nov 13 23:14:47 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:14:47 user nova-compute[75307]:     <video>
Nov 13 23:14:47 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:14:47 user nova-compute[75307]:     </video>
Nov 13 23:14:47 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:14:47 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:14:47 user nova-compute[75307]:     </rng>
Nov 13 23:14:47 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:14:47 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:14:47 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:14:47 user nova-compute[75307]:     </memballoon>
Nov 13 23:14:47 user nova-compute[75307]:   </devices>
Nov 13 23:14:47 user nova-compute[75307]: </domain>
Nov 13 23:14:47 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-485170644',display_name='tempest-VolumesAssistedSnapshotsTest-server-485170644',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-485170644',id=9,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkEOn8LipOSoXDVlFPK1HYi9pBEu5pJtuCIusBUEV3LXOI05dJsQ2P8EFSu35bdQ/w+DXxzhgMA4yYH79WNw0knWrJVbuT4SmQMmEOqQRY5cGXq9kNjCWvExaaHLyj4kg==',key_name='tempest-keypair-1574687254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4bf67291c7c44e33b44c9cfdf765b794',ramdisk_id='',reservation_id='r-mlvwqhn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1068930723',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1068930723-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e011923791740f786db97bbb6df72b5',uuid=e1e6da31-8158-4824-956b-c3f619dd06b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converting VIF {"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG os_vif [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1cefdcfb-f8d8-5cc9-ac9b-7c143696e4a4', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap800034b9-e0, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap800034b9-e0, col_values=(('qos', UUID('4ffa1179-676e-46e2-b1f7-c612ed26240c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap800034b9-e0, col_values=(('external_ids', {'iface-id': '800034b9-e021-423d-baea-389a08093ef6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6a:6c', 'vm-uuid': 'e1e6da31-8158-4824-956b-c3f619dd06b4'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:47 user nova-compute[75307]: INFO os_vif [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0')
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:14:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] No VIF found with MAC fa:16:3e:cc:6a:6c, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-changed-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Refreshing instance network info cache due to event network-changed-800034b9-e021-423d-baea-389a08093ef6. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] Acquiring lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] Acquired lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG nova.network.neutron [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Refreshing network info cache for port 800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG nova.network.neutron [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updated VIF entry in instance network info cache for port 800034b9-e021-423d-baea-389a08093ef6. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG nova.network.neutron [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating instance_info_cache with network_info: [{"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:14:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-913a1fa1-1827-4dd9-a8ef-530e5cdb4496 req-43028e73-5634-4a25-8520-9efed19076f4 service nova] Releasing lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:14:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:14:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Instance spawned successfully.
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:14:52 user nova-compute[75307]: INFO nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Took 8.33 seconds to spawn the instance on the hypervisor.
Nov 13 23:14:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:14:52 user nova-compute[75307]: INFO nova.compute.manager [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Took 9.46 seconds to build instance.
Nov 13 23:14:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1fe29f40-ce4d-4c91-a536-ab6483af48c6 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.587s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] No waiting events found dispatching network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:53 user nova-compute[75307]: WARNING nova.compute.manager [req-2be8ec6d-2998-4d33-a9fa-1d5946ca48b4 req-07d9b17e-7c03-4314-9763-9500b5be10e1 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received unexpected event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 for instance with vm_state active and task_state None.
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:54 user nova-compute[75307]: INFO nova.compute.claims [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Claim successful on node user
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] No waiting events found dispatching network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:14:55 user nova-compute[75307]: WARNING nova.compute.manager [req-3408c418-e9c2-4cd1-a5df-da56eb594ca1 req-d30d937b-17ca-43e2-866b-14f809b29b1c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received unexpected event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 for instance with vm_state active and task_state None.
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.713s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.436s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:14:55 user nova-compute[75307]: INFO nova.compute.claims [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Claim successful on node user
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:55 user nova-compute[75307]: INFO nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Booting with volume bb281af2-2436-400f-af9f-9ba3afff380a at /dev/vda
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.policy [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a393b4b200da47758de47328ac1db5b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77bb6fa016ff4af0a50f482b42bc697c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd43c7cf-21a1-4aeb-8717-670ab91e17a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd90a808-bf55-4d62-af5a-152214fb0503]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[62beaf2a-e7b7-4002-a73c-4a93861ff9db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f47fb-aabd-4fc7-8813-e43d35acd943]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:56 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db9f412-8d24-4903-9f09-86a03aa41d8d]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== get_connector_properties: return (264ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating existing volume attachment record: cbf96415-e057-4773-abaf-af6ea0f76940 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.895s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:14:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:14:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:14:56 user nova-compute[75307]: INFO nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Booting with volume 3ce39eef-0f09-49bb-b210-b6f80559a55b at /dev/vda
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[034a8ece-e245-4f23-aae0-eac725271c0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG nova.policy [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4fff7e1828fb40a7abf08b66561bf476', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d0d5bd749bf4842ad65455a62a38050', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.047s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8de5a1-5386-4acb-8c2a-ae52b70de413]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48effb8-073f-4216-b157-f7ce37bdb6d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f37c199-da6a-40a4-bd93-c2e4eccaaf9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:14:57 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba78282f-2764-469e-ac3b-72a626f4e5b9]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating existing volume attachment record: ffdce91a-fb83-4f3e-95a8-519eaf9f85e7 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully created port: 30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:14:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully created port: 529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully created port: bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Skipping network cache update for instance because it is Building. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Skipping network cache update for instance because it is Building. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:14:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully created port: 08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully created port: 29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating instance_info_cache with network_info: [{"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully created port: e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:15:01 user nova-compute[75307]: INFO nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Booting with volume 15abcfec-0170-476d-8fde-0cabd553cd3d at /dev/vdb
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c63f05b-784e-4853-aa62-87fafd1502ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully created port: 2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea42dbc-764f-460c-9bda-51bf2f03b35c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d3e70d-8d4f-48a5-a326-5001c98a9e43]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae322c4-8783-4c41-8d72-882ac6129260]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:01 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41c3731-9a36-48fe-813d-3f391f7f300a]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:01 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating existing volume attachment record: 0a528e5a-e925-41e5-9fdc-56d9769bc98b {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully created port: 66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: INFO nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Booting with volume 52d7e108-39a0-47f1-a217-3b5eb36ecc4e at /dev/vdb
Nov 13 23:15:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] No waiting events found dispatching network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:03 user nova-compute[75307]: WARNING nova.compute.manager [req-3a3ea808-257a-486d-81db-d6c723804f2e req-eca502b8-f5ef-49e3-ab9f-3e84f750fa14 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received unexpected event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec for instance with vm_state active and task_state None.
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95be463f-f92c-423d-98d5-29c88cea0123]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db38c30-fb85-40bc-9602-e361aa88e022]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d77979-1e00-4399-9771-36459e5b8d82]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[072033cd-86dd-4c84-aa78-55ff33274d50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:03 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec6da95-02de-4991-a89e-b2332bc339bf]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating existing volume attachment record: 8306d5d3-ad09-4fc7-8b0b-cc1a80e45c20 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully created port: 76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully created port: 96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:15:05 user nova-compute[75307]: INFO nova.compute.claims [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Claim successful on node user
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] No waiting events found dispatching network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:05 user nova-compute[75307]: WARNING nova.compute.manager [req-55454423-65b8-443d-9d2f-8107572cb3c8 req-3858fa70-17fd-4995-a7e5-4ca20db79a51 service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received unexpected event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec for instance with vm_state active and task_state None.
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-30a66290-39b4-431b-8cf3-b315d3b30d95. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.network.neutron [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:05 user nova-compute[75307]: DEBUG nova.network.neutron [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:06 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:06 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7180MB free_disk=25.596214294433594GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: 529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.255s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.328s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42463f4c-515d-4815-829f-ee9f6abe525f req-49e6d791-5246-4b80-b077-001304b63b61 service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:15:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 0f67a3a3-418a-4287-b639-8b285caaf4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e1e6da31-8158-4824-956b-c3f619dd06b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 88f67d93-784c-4a3c-950a-f018df17dbf9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9bae8cbf-0579-46ec-b459-fa47c43efe8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.policy [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:15:06 user nova-compute[75307]: INFO nova.virt.block_device [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Booting with volume snapshot 7a04e519-4ceb-4791-8a74-ce078a8a90e9 at /dev/vda
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:15:06 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.671s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-529a4d1e-d74f-4597-be93-4b8f78d5b83d. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:07 user nova-compute[75307]: INFO nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Booting with volume 8c0d7550-28e9-44c8-ad8e-9d7713a21732 at /dev/vdc
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[502e21bd-d6fb-4f76-a0ce-4a04150b726d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[970f43c9-4eb7-4510-a573-055cf0805e9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1916c9f-76b3-494b-838d-45ab0180ab8f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[35425c60-31dc-4d4a-8d4a-61d12da725d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:07 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[11aea730-4add-4f1d-b7a3-d93a67f8a2a7]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG os_brick.utils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:07 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating existing volume attachment record: 9a5951b6-007f-469e-8c20-1916e4f1e8d6 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG nova.network.neutron [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8df5bcb5-b04a-462f-a784-63cfb3801537 req-2f30fc50-ef42-4a18-b066-22348ffc1c58 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Successfully created port: 5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:08 user nova-compute[75307]: INFO nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Booting with volume 06ee24dd-a607-4abd-ac50-f9846a3d78f3 at /dev/vdc
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1366034a-88b4-49e6-879e-5f1e5e1a6ed7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99d6cac-6494-4817-81be-54c7f5e27bc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef392119-d498-446b-b091-970b92f7d726]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4719658-7f93-4254-856e-0c7b21c68f02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:08 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:08 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db2005-02cd-441c-8ee3-d81577024231]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG os_brick.utils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:08 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating existing volume attachment record: 5bc05f8e-bf5a-493a-9b8e-023cf4d8d9a4 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-776b8241-d302-44ff-a555-c3aed5b862ea. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-e12a5c67-8e16-4165-b605-343c0a49f279. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:09 user nova-compute[75307]: WARNING nova.compute.manager [req-9d15a096-f6de-4078-86e5-4b742dc72e14 req-58c2db75-6f3c-450f-b67e-e403d0359c6e service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state active and task_state None.
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-3fae5474-9283-4712-88f6-15f7e002f729. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Successfully updated port: 5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: 297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-82ffa387-5877-42c3-b5ae-3aade328f245 req-9971320f-179c-4f77-b4cf-e1de51e6594e service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Updating instance_info_cache with network_info: [{"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Instance network_info: |[{"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-changed-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Refreshing instance network info cache due to event network-changed-5454f7e7-63a9-4562-9303-9057b4241b3d. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquiring lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquired lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Refreshing network info cache for port 5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:11 user nova-compute[75307]: WARNING nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state active and task_state None.
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] No waiting events found dispatching network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:11 user nova-compute[75307]: WARNING nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received unexpected event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 for instance with vm_state active and task_state None.
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] No waiting events found dispatching network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:11 user nova-compute[75307]: WARNING nova.compute.manager [req-1ec6fcd2-d5bf-4466-9b17-5f1abb9747a1 req-217d1e6e-6281-4921-bf3c-b3371be4cb00 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received unexpected event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 for instance with vm_state active and task_state None.
Nov 13 23:15:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: 08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Updated VIF entry in instance network info cache for port 5454f7e7-63a9-4562-9303-9057b4241b3d. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Updating instance_info_cache with network_info: [{"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Releasing lock "refresh_cache-9bae8cbf-0579-46ec-b459-fa47c43efe8e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-297f6b9c-365b-4425-93f6-723289aa7f05. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:15:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Creating image(s)
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Ensure instance console log exists: /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.utils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-bf414311-7c66-4120-bb8d-f3bf1a4edf6c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[313ebd06-af81-4052-9d1f-fac857a3add6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff82f7d-23a7-4fd4-a7d7-0a1c978b40df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[280794ae-0b45-4318-82d6-2dbe7b970fac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d07b1c-ef91-475f-800b-bd4179dd50e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:13 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[24421f90-1c12-4ffa-ae4a-d6808ceba224]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG os_brick.utils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Updating existing volume attachment record: a54a4237-cd45-4723-826f-82f7d4179595 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:15:13 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Creating image(s)
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Ensure instance console log exists: /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-08662ca2-b0d2-49d8-9977-23e024ead7b2. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bde5db57-de0f-4e8f-9a43-c864aaa2f709 req-b56264b3-f0b7-4cc2-a48e-e311050b69a0 service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-29ba599d-1525-44d6-acb7-39e09bfdb2fc. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f9ef285-f29b-4ea3-ba1d-f0469b647a91 req-e42c25b6-76be-4c3a-9e55-feea8fac58e8 service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: 66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-66208d45-ab14-47f4-a5e9-9c8190d7d691. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd287a13-cf64-413e-8c9e-4d58348dccd6 req-47cb007e-d11b-4f89-97a7-8d77836788e0 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Successfully updated port: 76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Successfully updated port: 96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-e265bbba-9ac8-4285-9ab2-96cd40534cfc. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance network_info: |[{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Start _get_guest_xml network_info=[{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHQlOYWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88f67d93-784c-4a3c-950a-f018df17dbf9', 'attached_at': '', 'detached_at': '', 'volume_id': '3ce39eef-0f09-49bb-b210-b6f80559a55b', 'serial': '3ce39eef-0f09-49bb-b210-b6f80559a55b'}, 'delete_on_termination': False, 'attachment_id': 'ffdce91a-fb83-4f3e-95a8-519eaf9f85e7', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVprhDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88f67d93-784c-4a3c-950a-f018df17dbf9', 'attached_at': '', 'detached_at': '', 'volume_id': '52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 'serial': '52d7e108-39a0-47f1-a217-3b5eb36ecc4e'}, 'delete_on_termination': False, 'attachment_id': '8306d5d3-ad09-4fc7-8b0b-cc1a80e45c20', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFdQtsCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '88f67d93-784c-4a3c-950a-f018df17dbf9', 'attached_at': '', 'detached_at': '', 'volume_id': '06ee24dd-a607-4abd-ac50-f9846a3d78f3', 'serial': '06ee24dd-a607-4abd-ac50-f9846a3d78f3'}, 'delete_on_termination': False, 'attachment_id': '5bc05f8e-bf5a-493a-9b8e-023cf4d8d9a4', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance network_info: |[{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Start _get_guest_xml network_info=[{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTMgtiNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '168a86c8-0c1f-460a-b8c5-d09474abd204', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb281af2-2436-400f-af9f-9ba3afff380a', 'serial': 'bb281af2-2436-400f-af9f-9ba3afff380a'}, 'delete_on_termination': False, 'attachment_id': 'cbf96415-e057-4773-abaf-af6ea0f76940', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqigXVyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '168a86c8-0c1f-460a-b8c5-d09474abd204', 'attached_at': '', 'detached_at': '', 'volume_id': '15abcfec-0170-476d-8fde-0cabd553cd3d', 'serial': '15abcfec-0170-476d-8fde-0cabd553cd3d'}, 'delete_on_termination': False, 'attachment_id': '0a528e5a-e925-41e5-9fdc-56d9769bc98b', 'guest_format': None, 'boot_index': 1, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbWlGcRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '168a86c8-0c1f-460a-b8c5-d09474abd204', 'attached_at': '', 'detached_at': '', 'volume_id': '8c0d7550-28e9-44c8-ad8e-9d7713a21732', 'serial': '8c0d7550-28e9-44c8-ad8e-9d7713a21732'}, 'delete_on_termination': False, 'attachment_id': '9a5951b6-007f-469e-8c20-1916e4f1e8d6', 'guest_format': None, 'boot_index': 2, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHQlOYWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:17 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTMgtiNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ae3fbd-d0c7-42a7-b97a-71c8d0abacca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:17 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[809d9fe6-5b9c-46b5-8eb6-a6478498985d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b] added
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca63cd-403a-4492-961c-433b625aec90]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24703a9-1580-4f40-a4ab-c77232c41daa]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHQlOYWm {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHQlOYWm" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b91b2f-bbda-43f2-9bdb-e21b378479f1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHQlOYWm'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa005be-a485-4732-abf7-1d4b63212b16]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c93797e-bed8-48ad-92cc-ae4457c3e72f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[87677c79-0d2d-43cb-8e83-0333ba155125]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260]
Nov 13 23:15:17 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a895f7e-f590-4a01-8277-36bb52fd8a5a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:15:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Creating image(s)
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Ensure instance console log exists: /opt/stack/data/nova/instances/9bae8cbf-0579-46ec-b459-fa47c43efe8e/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Start _get_guest_xml network_info=[{"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqvKgXxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9bae8cbf-0579-46ec-b459-fa47c43efe8e', 'attached_at': '', 'detached_at': '', 'volume_id': '2151b7e9-0651-4480-aff7-67c93be5e074', 'serial': '2151b7e9-0651-4480-aff7-67c93be5e074'}, 'delete_on_termination': True, 'attachment_id': 'a54a4237-cd45-4723-826f-82f7d4179595', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3fa891-94a0-4ba7-a05b-fb661c681488]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:17 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:17 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqvKgXxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a805a5b3-fef7-4da8-805c-bb2349d375b5]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHQlOYWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updated VIF entry in instance network info cache for port e265bbba-9ac8-4285-9ab2-96cd40534cfc. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updated VIF entry in instance network info cache for port 2f9b7d7e-0154-42b0-b867-3dbb6cc0facb. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updated VIF entry in instance network info cache for port 96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-76aef077-44a9-4e57-bc0a-dce4fe48a29a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4fde7794-39b7-411d-b289-892b04375909 req-476309d3-a6a2-4b73-afd2-dad69a6245b6 service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23634663034333537', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634663034333537', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.304s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:18 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:18 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVprhDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:18 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d5bda-36d9-4e29-8cb6-cb74e8c8e0d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:18 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcefe16f-7d44-4aac-88c3-919865775690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a] added
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b5732b-a3a2-4c87-b41d-a54b8300a2bc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab844bb-a6e4-43f7-9db7-7fe3bdea82b2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTMgtiNE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updated VIF entry in instance network info cache for port 76aef077-44a9-4e57-bc0a-dce4fe48a29a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wTMgtiNE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a58b9d8-5101-4fe8-baa9-b9d8b7744dc0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wTMgtiNE'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b703d21-35f8-4ff9-b30e-2bb2486e17fb req-b2c27876-f1f9-4202-af87-215253ac1425 service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebcc02d-07ec-4a79-b01a-cae640a2d4e3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[473a83e5-c246-483e-80d5-d722b3d1d9bb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b54647ec-0d22-4e32-98c6-c12193484a0d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260]
Nov 13 23:15:19 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f566b5b-20c4-4c8c-8dda-7cab5c1b882a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed66876-76d7-4559-ba1c-7a119ce9048f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:19 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7628b379-2228-42b2-9467-419b666b1217]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTMgtiNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== connect_volume: return (2621ms) {'type': 'block', 'scsi_wwn': '26630646432343764', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630646432343764', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.332s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:20 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqigXVyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dbc2db-dd39-4aba-a15d-69972dac4d00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:20 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8b9a48-4f07-4d66-b8c5-a6e4cb0c6383]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074] added
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fde9a6-1740-4fc9-b4bb-2bad7a24b3c0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9842713-a4c0-4561-bc54-44dacf21a33c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqvKgXxt {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iqvKgXxt" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd799d21-6429-4758-91a0-63e1fa771db4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iqvKgXxt'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[658f9ad0-2af0-4fc3-b483-3df32ddf9589]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89d814a-f1ea-4644-8f3d-d49e65e19eb5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[03107e84-ca08-4189-ad4b-a94368f4a6fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260]
Nov 13 23:15:20 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb00165-2b62-4bda-ad71-3ae0816b74a0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66241f7f-13cb-4fef-b7c6-3e1761f7f449]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:20 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbddf1c6-4e12-430e-9356-5ff009767497]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqvKgXxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (3665ms) {'type': 'block', 'scsi_wwn': '26166396166333562', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166396166333562', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.628s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:21 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c703c740-a04d-4ccf-8b01-a1e2d8a9b514]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:21 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829958291',display_name='tempest-TestVolumeBootPattern-server-1829958291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1829958291',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-azkg168o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:15:07Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=9bae8cbf-0579-46ec-b459-fa47c43efe8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bae8cbf-0579-46ec-b459-fa47c43efe8e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:15:21 user nova-compute[75307]:   <uuid>9bae8cbf-0579-46ec-b459-fa47c43efe8e</uuid>
Nov 13 23:15:21 user nova-compute[75307]:   <name>instance-0000000c</name>
Nov 13 23:15:21 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:15:21 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:15:21 user nova-compute[75307]:   <metadata>
Nov 13 23:15:21 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:15:21 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:15:21 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-server-1829958291</nova:name>
Nov 13 23:15:21 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:15:17</nova:creationTime>
Nov 13 23:15:21 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:15:21 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:15:21 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:15:21 user nova-compute[75307]:       <nova:owner>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:15:21 user nova-compute[75307]:       </nova:owner>
Nov 13 23:15:21 user nova-compute[75307]:       <nova:ports>
Nov 13 23:15:21 user nova-compute[75307]:         <nova:port uuid="5454f7e7-63a9-4562-9303-9057b4241b3d">
Nov 13 23:15:21 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:15:21 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:21 user nova-compute[75307]:       </nova:ports>
Nov 13 23:15:21 user nova-compute[75307]:     </nova:instance>
Nov 13 23:15:21 user nova-compute[75307]:   </metadata>
Nov 13 23:15:21 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:15:21 user nova-compute[75307]:     <system>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="serial">9bae8cbf-0579-46ec-b459-fa47c43efe8e</entry>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="uuid">9bae8cbf-0579-46ec-b459-fa47c43efe8e</entry>
Nov 13 23:15:21 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:15:21 user nova-compute[75307]:     </system>
Nov 13 23:15:21 user nova-compute[75307]:   </sysinfo>
Nov 13 23:15:21 user nova-compute[75307]:   <os>
Nov 13 23:15:21 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:15:21 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:15:21 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:15:21 user nova-compute[75307]:   </os>
Nov 13 23:15:21 user nova-compute[75307]:   <features>
Nov 13 23:15:21 user nova-compute[75307]:     <acpi/>
Nov 13 23:15:21 user nova-compute[75307]:     <apic/>
Nov 13 23:15:21 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:15:21 user nova-compute[75307]:   </features>
Nov 13 23:15:21 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:15:21 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:15:21 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:15:21 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:15:21 user nova-compute[75307]:   </clock>
Nov 13 23:15:21 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:15:21 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:15:21 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:15:21 user nova-compute[75307]:   </cpu>
Nov 13 23:15:21 user nova-compute[75307]:   <devices>
Nov 13 23:15:21 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:21 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:21 user nova-compute[75307]:       <source dev="/dev/sde"/>
Nov 13 23:15:21 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:15:21 user nova-compute[75307]:       <serial>2151b7e9-0651-4480-aff7-67c93be5e074</serial>
Nov 13 23:15:21 user nova-compute[75307]:     </disk>
Nov 13 23:15:21 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:21 user nova-compute[75307]:       <mac address="fa:16:3e:a4:3d:00"/>
Nov 13 23:15:21 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:21 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:21 user nova-compute[75307]:       <target dev="tap5454f7e7-63"/>
Nov 13 23:15:21 user nova-compute[75307]:     </interface>
Nov 13 23:15:21 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:15:21 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/9bae8cbf-0579-46ec-b459-fa47c43efe8e/console.log" append="off"/>
Nov 13 23:15:21 user nova-compute[75307]:     </serial>
Nov 13 23:15:21 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:15:21 user nova-compute[75307]:     <video>
Nov 13 23:15:21 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:21 user nova-compute[75307]:     </video>
Nov 13 23:15:21 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:15:21 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:15:21 user nova-compute[75307]:     </rng>
Nov 13 23:15:21 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:15:21 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:15:21 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:15:21 user nova-compute[75307]:     </memballoon>
Nov 13 23:15:21 user nova-compute[75307]:   </devices>
Nov 13 23:15:21 user nova-compute[75307]: </domain>
Nov 13 23:15:21 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829958291',display_name='tempest-TestVolumeBootPattern-server-1829958291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1829958291',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-azkg168o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:15:07Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=9bae8cbf-0579-46ec-b459-fa47c43efe8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_vif [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[165d1402-430e-412e-9983-0b20d30d1103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e] added
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd166c398-0459-54ef-8e2b-4a30a86527e2', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5454f7e7-63, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5454f7e7-63, col_values=(('qos', UUID('c34a647b-0e96-4604-aabb-411e8c167cc5')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5454f7e7-63, col_values=(('external_ids', {'iface-id': '5454f7e7-63a9-4562-9303-9057b4241b3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:3d:00', 'vm-uuid': '9bae8cbf-0579-46ec-b459-fa47c43efe8e'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee21ce08-83ae-44e5-8baa-3b9fc34b4846]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:21 user nova-compute[75307]: INFO os_vif [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63')
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b938c985-314e-4535-bd4e-3fac81d4540a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNVprhDa {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eNVprhDa" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a535a95-bde8-4cd2-bf85-f5ac0c38b5db]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eNVprhDa'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:a4:3d:00, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[961c7eed-d841-441c-a0d6-46bf8e95307b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ba6ea5-a52f-4f6d-89bb-c7b8ab1c83ca]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d593eb8-0667-49c1-b953-df78d335ffd6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260]
Nov 13 23:15:21 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc68ee0-3d80-4d80-a459-9d99562f225a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[55550341-64f6-46c8-9bb1-d1b110fa78e2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:21 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b416e4df-efa1-488b-a17a-8417f35333cd]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVprhDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== connect_volume: return (3956ms) {'type': 'block', 'scsi_wwn': '26530663437376438', 'path': '/dev/sdf'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530663437376438', 'path': '/dev/sdf'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.636s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:22 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc8a077-96ab-457a-b585-6ff70ad5e2de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:22 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFdQtsCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[88eece67-a1f5-4c95-bbda-607dff6787e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d] added
Nov 13 23:15:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b00ee5-e962-477e-85d1-984715770ef7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe406a5-06e3-4a81-a483-e61960754e15]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqigXVyE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqigXVyE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd169fdc-f1fa-45e8-857e-3c134b4849d7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqigXVyE'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[922bcbe4-8139-493f-85c5-4f051e8eb8ad]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[db09a7c0-0561-4213-91e3-8110d14defff]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] No waiting events found dispatching network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:23 user nova-compute[75307]: WARNING nova.compute.manager [req-554ec971-6ff7-4138-8ae1-a043a762cb5d req-ea5a88ef-e7e5-4515-b18a-38f491b259a4 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received unexpected event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d for instance with vm_state building and task_state spawning.
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59639b6-4688-4675-a72d-47f3c5057b85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260]
Nov 13 23:15:23 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab660d4-dd80-4f1c-8377-d35bd1cf2485]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3dc5e-7534-41ec-8fc5-6ad3c8d8b845]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:23 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[435993cb-50f2-4e9e-91f3-5f817ca20da1]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqigXVyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.359s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== connect_volume: return (3996ms) {'type': 'block', 'scsi_wwn': '23863643939656136', 'path': '/dev/sdg'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23863643939656136', 'path': '/dev/sdg'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:24 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:24 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bef1fc-cd65-4e45-89a4-7376fd999d7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:24 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbWlGcRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:24 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10069e8e-26c3-47ae-a397-c85c456ad574]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3] added
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74864c1-e9cc-4c31-83a8-e3ae122f328a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a558b4-4d6e-4755-b92f-939ce4b40ece]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFdQtsCU {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MFdQtsCU" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e617b4f-79cd-4cd2-8a93-7d2747f3138c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MFdQtsCU'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c59300-8fcc-4b3f-9ae3-f17c0b1f34f7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[58afd20f-a493-40fc-9073-a94f50500e10]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a347381f-90ad-4c7f-9a0d-655aaa063efc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260]
Nov 13 23:15:24 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb1deda-3144-43b8-a5c3-4dfe97868868]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3792f151-3322-42b0-a93a-b2458adefc06]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be76290-b33c-4feb-8cb3-b20307892235]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFdQtsCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:15:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Instance spawned successfully.
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:25 user nova-compute[75307]: INFO nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Took 7.31 seconds to spawn the instance on the hypervisor.
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] No waiting events found dispatching network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:25 user nova-compute[75307]: WARNING nova.compute.manager [req-e385b570-3301-4e6e-8b05-83a55b0f0f55 req-cce8911d-382e-4677-84cb-2dfe8cdf59c7 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received unexpected event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d for instance with vm_state building and task_state spawning.
Nov 13 23:15:25 user nova-compute[75307]: INFO nova.compute.manager [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Took 20.45 seconds to build instance.
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-398009a6-52c5-4f30-aa08-679d1fe665b7 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.575s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== connect_volume: return (2665ms) {'type': 'block', 'scsi_wwn': '23634626166373637', 'path': '/dev/sdh'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634626166373637', 'path': '/dev/sdh'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.294s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:15:25 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a57ddfb-9684-40dc-84a9-ef1db6530639]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:15:25 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.objects.instance [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lazy-loading 'pci_devices' on Instance uuid 88f67d93-784c-4a3c-950a-f018df17dbf9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daaf685-50ff-4257-ae86-b4347f97835b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732] added
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:15:25 user nova-compute[75307]:   <uuid>88f67d93-784c-4a3c-950a-f018df17dbf9</uuid>
Nov 13 23:15:25 user nova-compute[75307]:   <name>instance-0000000b</name>
Nov 13 23:15:25 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:15:25 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:15:25 user nova-compute[75307]:   <metadata>
Nov 13 23:15:25 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:15:25 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:name>tempest-device-tagging-server-244937618</nova:name>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:15:17</nova:creationTime>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:15:25 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:15:25 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:owner>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:user uuid="4fff7e1828fb40a7abf08b66561bf476">tempest-TaggedBootDevicesTest_v242-1231581178-project-member</nova:user>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:project uuid="7d0d5bd749bf4842ad65455a62a38050">tempest-TaggedBootDevicesTest_v242-1231581178</nova:project>
Nov 13 23:15:25 user nova-compute[75307]:       </nova:owner>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:15:25 user nova-compute[75307]:       <nova:ports>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="529a4d1e-d74f-4597-be93-4b8f78d5b83d">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="e12a5c67-8e16-4165-b605-343c0a49f279">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.18" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="297f6b9c-365b-4425-93f6-723289aa7f05">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.183" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="08662ca2-b0d2-49d8-9977-23e024ead7b2">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.200" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="e265bbba-9ac8-4285-9ab2-96cd40534cfc">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="66208d45-ab14-47f4-a5e9-9c8190d7d691">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:         <nova:port uuid="96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0">
Nov 13 23:15:25 user nova-compute[75307]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 23:15:25 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:25 user nova-compute[75307]:       </nova:ports>
Nov 13 23:15:25 user nova-compute[75307]:     </nova:instance>
Nov 13 23:15:25 user nova-compute[75307]:   </metadata>
Nov 13 23:15:25 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:15:25 user nova-compute[75307]:     <system>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="serial">88f67d93-784c-4a3c-950a-f018df17dbf9</entry>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="uuid">88f67d93-784c-4a3c-950a-f018df17dbf9</entry>
Nov 13 23:15:25 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:15:25 user nova-compute[75307]:     </system>
Nov 13 23:15:25 user nova-compute[75307]:   </sysinfo>
Nov 13 23:15:25 user nova-compute[75307]:   <os>
Nov 13 23:15:25 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:15:25 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:15:25 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:15:25 user nova-compute[75307]:   </os>
Nov 13 23:15:25 user nova-compute[75307]:   <features>
Nov 13 23:15:25 user nova-compute[75307]:     <acpi/>
Nov 13 23:15:25 user nova-compute[75307]:     <apic/>
Nov 13 23:15:25 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:15:25 user nova-compute[75307]:   </features>
Nov 13 23:15:25 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:15:25 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:15:25 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:15:25 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:15:25 user nova-compute[75307]:   </clock>
Nov 13 23:15:25 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:15:25 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:15:25 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:15:25 user nova-compute[75307]:   </cpu>
Nov 13 23:15:25 user nova-compute[75307]:   <devices>
Nov 13 23:15:25 user nova-compute[75307]:     <disk type="file" device="cdrom">
Nov 13 23:15:25 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 23:15:25 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/disk.config"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="hda" bus="ide"/>
Nov 13 23:15:25 user nova-compute[75307]:     </disk>
Nov 13 23:15:25 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:25 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:25 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <serial>3ce39eef-0f09-49bb-b210-b6f80559a55b</serial>
Nov 13 23:15:25 user nova-compute[75307]:     </disk>
Nov 13 23:15:25 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:25 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:25 user nova-compute[75307]:       <source dev="/dev/sdf"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <serial>52d7e108-39a0-47f1-a217-3b5eb36ecc4e</serial>
Nov 13 23:15:25 user nova-compute[75307]:     </disk>
Nov 13 23:15:25 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:25 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:25 user nova-compute[75307]:       <source dev="/dev/sdh"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="vdc" bus="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <serial>06ee24dd-a607-4abd-ac50-f9846a3d78f3</serial>
Nov 13 23:15:25 user nova-compute[75307]:     </disk>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:32:65:3b"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tap529a4d1e-d7"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:95:38:4e"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tape12a5c67-8e"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:cb:de:29"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tap297f6b9c-36"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:6f:71:47"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tap08662ca2-b0"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:bf:70:42"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tape265bbba-9a"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:02:43:54"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tap66208d45-ab"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:25 user nova-compute[75307]:       <mac address="fa:16:3e:ee:89:d5"/>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:25 user nova-compute[75307]:       <target dev="tap96f15ea7-8a"/>
Nov 13 23:15:25 user nova-compute[75307]:     </interface>
Nov 13 23:15:25 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:15:25 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/console.log" append="off"/>
Nov 13 23:15:25 user nova-compute[75307]:     </serial>
Nov 13 23:15:25 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:15:25 user nova-compute[75307]:     <video>
Nov 13 23:15:25 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:25 user nova-compute[75307]:     </video>
Nov 13 23:15:25 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:15:25 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:15:25 user nova-compute[75307]:     </rng>
Nov 13 23:15:25 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:15:25 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:15:25 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:15:25 user nova-compute[75307]:     </memballoon>
Nov 13 23:15:25 user nova-compute[75307]:   </devices>
Nov 13 23:15:25 user nova-compute[75307]: </domain>
Nov 13 23:15:25 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2a07799-dcb9-568d-ab49-f852aac03a70', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dabce42-ad20-4aa7-b559-f40f62d69b17]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap529a4d1e-d7, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap529a4d1e-d7, col_values=(('qos', UUID('fe56db6e-1fef-4c46-9085-86be93b30bd9')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap529a4d1e-d7, col_values=(('external_ids', {'iface-id': '529a4d1e-d74f-4597-be93-4b8f78d5b83d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:65:3b', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9adf8f-ef95-48f7-b383-c311d65208ad]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7')
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbWlGcRA {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b01c5e35-582e-5285-b3e5-5ae9d360fc94', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XbWlGcRA" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0113eb-4fa2-46fb-bca3-08a55fc3de81]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XbWlGcRA'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape12a5c67-8e, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape12a5c67-8e, col_values=(('qos', UUID('2a7a2a2e-4454-49d6-abb6-bf1bddae2ca4')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape12a5c67-8e, col_values=(('external_ids', {'iface-id': 'e12a5c67-8e16-4165-b605-343c0a49f279', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:38:4e', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f167c4-5f64-4c8f-ab18-9fa9945ac6d9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e')
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c95ac38f-7216-5103-8358-a8b098cf863b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12eac00-652f-4478-8349-7e8d5dd52ac9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap297f6b9c-36, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap297f6b9c-36, col_values=(('qos', UUID('92f3a5ef-6542-4cb6-af72-ac76b01edb11')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap297f6b9c-36, col_values=(('external_ids', {'iface-id': '297f6b9c-365b-4425-93f6-723289aa7f05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:de:29', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36')
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd96386cc-fd37-51f2-b192-1a4ba91ce33b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08662ca2-b0, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08662ca2-b0, col_values=(('qos', UUID('cb3acb08-e59e-404a-a836-40ecd01c2419')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08662ca2-b0, col_values=(('external_ids', {'iface-id': '08662ca2-b0d2-49d8-9977-23e024ead7b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:71:47', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91a5620-a5c3-4c8d-b6ab-fbba8cce737c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260]
Nov 13 23:15:25 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260] successful.
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a63095-d695-4350-a2f8-218cd4831ca3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0')
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f56fac4d-9e57-54aa-a4c4-5b5c702c2c63', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[403ef386-a65b-4bf5-a3ef-f5adca8ec672]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:15:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] HCTL ('40', '-', '-', 0) found on session 9 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:15:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1784e53a-e506-4176-8c15-6777a91f6ac5]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Searching for a device in session 9 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbWlGcRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape265bbba-9a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape265bbba-9a, col_values=(('qos', UUID('7e8854bb-5988-413b-9519-8d2315831d7b')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape265bbba-9a, col_values=(('external_ids', {'iface-id': 'e265bbba-9ac8-4285-9ab2-96cd40534cfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:70:42', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a')
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e010f84-6382-5da4-be57-46db6782492c', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap66208d45-ab, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap66208d45-ab, col_values=(('qos', UUID('07f4f478-63b5-4fde-834e-42cce89751fe')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap66208d45-ab, col_values=(('external_ids', {'iface-id': '66208d45-ab14-47f4-a5e9-9c8190d7d691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:43:54', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab')
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2c36753-2f0c-521b-a75c-8d236b106de5', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96f15ea7-8a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96f15ea7-8a, col_values=(('qos', UUID('51d74cc5-ff12-44c1-a50a-16792c2fd5b7')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96f15ea7-8a, col_values=(('external_ids', {'iface-id': '96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:89:d5', 'vm-uuid': '88f67d93-784c-4a3c-950a-f018df17dbf9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:26 user nova-compute[75307]: INFO os_vif [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a')
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] No BDM found with device name hda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] No VIF found with MAC fa:16:3e:32:65:3b, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] No VIF found with MAC fa:16:3e:bf:70:42, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Using config drive
Nov 13 23:15:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Creating config drive at /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/disk.config
Nov 13 23:15:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_cowu2kn {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_cowu2kn" returned: 0 in 0.066s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== connect_volume: return (2675ms) {'type': 'block', 'scsi_wwn': '23666343538626135', 'path': '/dev/sdi'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666343538626135', 'path': '/dev/sdi'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.objects.instance [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lazy-loading 'pci_devices' on Instance uuid 168a86c8-0c1f-460a-b8c5-d09474abd204 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:15:27 user nova-compute[75307]:   <uuid>168a86c8-0c1f-460a-b8c5-d09474abd204</uuid>
Nov 13 23:15:27 user nova-compute[75307]:   <name>instance-0000000a</name>
Nov 13 23:15:27 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:15:27 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:15:27 user nova-compute[75307]:   <metadata>
Nov 13 23:15:27 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:15:27 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:name>tempest-device-tagging-server-1737812577</nova:name>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:15:17</nova:creationTime>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:15:27 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:15:27 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:owner>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:user uuid="a393b4b200da47758de47328ac1db5b2">tempest-TaggedBootDevicesTest-355361262-project-member</nova:user>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:project uuid="77bb6fa016ff4af0a50f482b42bc697c">tempest-TaggedBootDevicesTest-355361262</nova:project>
Nov 13 23:15:27 user nova-compute[75307]:       </nova:owner>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:15:27 user nova-compute[75307]:       <nova:ports>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="30a66290-39b4-431b-8cf3-b315d3b30d95">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="776b8241-d302-44ff-a555-c3aed5b862ea">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.75" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="3fae5474-9283-4712-88f6-15f7e002f729">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.199" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="bf414311-7c66-4120-bb8d-f3bf1a4edf6c">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="29ba599d-1525-44d6-acb7-39e09bfdb2fc">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.1.1.72" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="2f9b7d7e-0154-42b0-b867-3dbb6cc0facb">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:         <nova:port uuid="76aef077-44a9-4e57-bc0a-dce4fe48a29a">
Nov 13 23:15:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 13 23:15:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:27 user nova-compute[75307]:       </nova:ports>
Nov 13 23:15:27 user nova-compute[75307]:     </nova:instance>
Nov 13 23:15:27 user nova-compute[75307]:   </metadata>
Nov 13 23:15:27 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:15:27 user nova-compute[75307]:     <system>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="serial">168a86c8-0c1f-460a-b8c5-d09474abd204</entry>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="uuid">168a86c8-0c1f-460a-b8c5-d09474abd204</entry>
Nov 13 23:15:27 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:15:27 user nova-compute[75307]:     </system>
Nov 13 23:15:27 user nova-compute[75307]:   </sysinfo>
Nov 13 23:15:27 user nova-compute[75307]:   <os>
Nov 13 23:15:27 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:15:27 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:15:27 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:15:27 user nova-compute[75307]:   </os>
Nov 13 23:15:27 user nova-compute[75307]:   <features>
Nov 13 23:15:27 user nova-compute[75307]:     <acpi/>
Nov 13 23:15:27 user nova-compute[75307]:     <apic/>
Nov 13 23:15:27 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:15:27 user nova-compute[75307]:   </features>
Nov 13 23:15:27 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:15:27 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:15:27 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:15:27 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:15:27 user nova-compute[75307]:   </clock>
Nov 13 23:15:27 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:15:27 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:15:27 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:15:27 user nova-compute[75307]:   </cpu>
Nov 13 23:15:27 user nova-compute[75307]:   <devices>
Nov 13 23:15:27 user nova-compute[75307]:     <disk type="file" device="cdrom">
Nov 13 23:15:27 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none"/>
Nov 13 23:15:27 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/disk.config"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="hda" bus="ide"/>
Nov 13 23:15:27 user nova-compute[75307]:     </disk>
Nov 13 23:15:27 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:27 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:27 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <serial>bb281af2-2436-400f-af9f-9ba3afff380a</serial>
Nov 13 23:15:27 user nova-compute[75307]:     </disk>
Nov 13 23:15:27 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:27 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:27 user nova-compute[75307]:       <source dev="/dev/sdg"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <serial>15abcfec-0170-476d-8fde-0cabd553cd3d</serial>
Nov 13 23:15:27 user nova-compute[75307]:     </disk>
Nov 13 23:15:27 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:15:27 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:15:27 user nova-compute[75307]:       <source dev="/dev/sdi"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="vdc" bus="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <serial>8c0d7550-28e9-44c8-ad8e-9d7713a21732</serial>
Nov 13 23:15:27 user nova-compute[75307]:     </disk>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:b2:d6:ad"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap30a66290-39"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:e4:9c:7b"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap776b8241-d3"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:d6:c0:03"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap3fae5474-92"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:2a:14:78"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tapbf414311-7c"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:40:3e:42"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap29ba599d-15"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:60:53:4f"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap2f9b7d7e-01"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:27 user nova-compute[75307]:       <mac address="fa:16:3e:e7:bc:ef"/>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:27 user nova-compute[75307]:       <target dev="tap76aef077-44"/>
Nov 13 23:15:27 user nova-compute[75307]:     </interface>
Nov 13 23:15:27 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:15:27 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/console.log" append="off"/>
Nov 13 23:15:27 user nova-compute[75307]:     </serial>
Nov 13 23:15:27 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:15:27 user nova-compute[75307]:     <video>
Nov 13 23:15:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:27 user nova-compute[75307]:     </video>
Nov 13 23:15:27 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:15:27 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:15:27 user nova-compute[75307]:     </rng>
Nov 13 23:15:27 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:15:27 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:15:27 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:15:27 user nova-compute[75307]:     </memballoon>
Nov 13 23:15:27 user nova-compute[75307]:   </devices>
Nov 13 23:15:27 user nova-compute[75307]: </domain>
Nov 13 23:15:27 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aac019d5-0e8c-5076-b61b-eb5ab6523361', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30a66290-39, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30a66290-39, col_values=(('qos', UUID('2ead3aa4-14a5-4efb-98b4-a4cd40347ad2')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30a66290-39, col_values=(('external_ids', {'iface-id': '30a66290-39b4-431b-8cf3-b315d3b30d95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:d6:ad', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39')
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '96a402ad-eceb-52f8-a2bf-ef2eca730c61', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap776b8241-d3, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap776b8241-d3, col_values=(('qos', UUID('d5a840c6-bd12-48e0-a08f-e01c5b7c8348')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap776b8241-d3, col_values=(('external_ids', {'iface-id': '776b8241-d302-44ff-a555-c3aed5b862ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:9c:7b', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3')
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d419cd1-d89a-5ec6-bb39-d9ccf60d798b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3fae5474-92, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3fae5474-92, col_values=(('qos', UUID('7b3efa12-5732-468f-9f86-29f38a70e780')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3fae5474-92, col_values=(('external_ids', {'iface-id': '3fae5474-9283-4712-88f6-15f7e002f729', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c0:03', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92')
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50222dfb-2a64-593a-920c-bae767883a07', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf414311-7c, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbf414311-7c, col_values=(('qos', UUID('72248b66-e353-4c6c-813e-bcfd17b925f6')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbf414311-7c, col_values=(('external_ids', {'iface-id': 'bf414311-7c66-4120-bb8d-f3bf1a4edf6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:14:78', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c')
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0ef04d37-1a5f-5ae6-88ca-b32239b0068d', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ba599d-15, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29ba599d-15, col_values=(('qos', UUID('b3633150-9a8e-4481-89c2-897bd115bc08')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29ba599d-15, col_values=(('external_ids', {'iface-id': '29ba599d-1525-44d6-acb7-39e09bfdb2fc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:3e:42', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15')
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f48efa1-803d-51d7-8ed3-1da6188c7c0f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:28 user nova-compute[75307]: WARNING nova.compute.manager [req-e6e05b0c-0015-4c93-9616-90ffe5cec968 req-4ff646cd-7d54-44d0-b031-75b08b0228b9 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d for instance with vm_state building and task_state spawning.
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f9b7d7e-01, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f9b7d7e-01, col_values=(('qos', UUID('a00142ed-987b-4dfd-b2f7-bfd8bc4a438c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f9b7d7e-01, col_values=(('external_ids', {'iface-id': '2f9b7d7e-0154-42b0-b867-3dbb6cc0facb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:53:4f', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01')
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '440aa3e4-28f1-5d1b-b900-c13769ec6583', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap76aef077-44, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap76aef077-44, col_values=(('qos', UUID('a30348e2-0c31-408a-8e23-9d29157e82ce')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap76aef077-44, col_values=(('external_ids', {'iface-id': '76aef077-44a9-4e57-bc0a-dce4fe48a29a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:bc:ef', 'vm-uuid': '168a86c8-0c1f-460a-b8c5-d09474abd204'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: INFO os_vif [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44')
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:29 user nova-compute[75307]: WARNING nova.compute.manager [req-b02935c2-73e6-4c15-80d0-f5c8c4e8cba7 req-74fdad1a-c640-473e-9d58-3680505589ee service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 for instance with vm_state building and task_state spawning.
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] No BDM found with device name hda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] No VIF found with MAC fa:16:3e:b2:d6:ad, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] No VIF found with MAC fa:16:3e:40:3e:42, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Using config drive
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Creating config drive at /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/disk.config
Nov 13 23:15:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn36x5849 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpn36x5849" returned: 0 in 0.057s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:30 user nova-compute[75307]: WARNING nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d for instance with vm_state building and task_state spawning.
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:30 user nova-compute[75307]: WARNING nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 for instance with vm_state building and task_state spawning.
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:30 user nova-compute[75307]: WARNING nova.compute.manager [req-18d70173-b520-486e-a5da-8a047b1106ed req-53513cd4-30c2-4eb3-b61a-c482997b4d9f service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 for instance with vm_state building and task_state spawning.
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-83087538-a820-412a-bb4a-d54ac93393a6 req-e7bf9673-784c-4799-82d6-f65d18692505 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:31 user nova-compute[75307]: WARNING nova.compute.manager [req-720c708c-f6ef-4485-9fb1-d1953509646b req-e5631ced-eadc-42c0-bad9-28abd2ce7393 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc for instance with vm_state building and task_state spawning.
Nov 13 23:15:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:32 user nova-compute[75307]: WARNING nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 for instance with vm_state building and task_state spawning.
Nov 13 23:15:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:32 user nova-compute[75307]: WARNING nova.compute.manager [req-6024c3be-e93f-434f-95fa-c152be686790 req-9f5b2571-353e-4e61-94df-dd844bbaedf7 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 for instance with vm_state building and task_state spawning.
Nov 13 23:15:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:33 user nova-compute[75307]: WARNING nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 for instance with vm_state building and task_state spawning.
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:33 user nova-compute[75307]: WARNING nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 for instance with vm_state building and task_state spawning.
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:33 user nova-compute[75307]: WARNING nova.compute.manager [req-3178d5e9-290f-4141-a9da-b9ef3fecbb88 req-d6ddf74c-a700-44f0-a744-52e9ccb321f0 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 for instance with vm_state building and task_state spawning.
Nov 13 23:15:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:33 user nova-compute[75307]: WARNING nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea for instance with vm_state building and task_state spawning.
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:33 user nova-compute[75307]: WARNING nova.compute.manager [req-849b298a-1971-44a7-acf4-d3a81c70dde7 req-51d6c5f0-ea95-4cff-93b7-65879577f2d2 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea for instance with vm_state building and task_state spawning.
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:15:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance spawned successfully.
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:34 user nova-compute[75307]: WARNING nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 for instance with vm_state building and task_state spawning.
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:34 user nova-compute[75307]: WARNING nova.compute.manager [req-e423878d-db28-46db-8236-b6b5cc25c30c req-b1445779-deb3-4e5b-9b0f-84080b0b0571 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 for instance with vm_state building and task_state spawning.
Nov 13 23:15:34 user nova-compute[75307]: INFO nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Took 21.08 seconds to spawn the instance on the hypervisor.
Nov 13 23:15:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:15:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:34 user nova-compute[75307]: INFO nova.compute.manager [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Took 39.88 seconds to build instance.
Nov 13 23:15:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-98f03e86-9a75-4555-b003-cc3d08e8b726 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.027s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-085f37a5-df8c-4070-bd22-65f38291a73b req-cd1d8705-6901-462d-8bd4-0366a68408fd service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a for instance with vm_state building and task_state spawning.
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:35 user nova-compute[75307]: WARNING nova.compute.manager [req-6accab1d-493b-487a-baa0-fa2b1503d838 req-138deb79-74ba-4a11-b921-e2e01773b490 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a for instance with vm_state building and task_state spawning.
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:15:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance spawned successfully.
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:15:37 user nova-compute[75307]: INFO nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Took 24.28 seconds to spawn the instance on the hypervisor.
Nov 13 23:15:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:15:37 user nova-compute[75307]: INFO nova.compute.manager [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Took 42.32 seconds to build instance.
Nov 13 23:15:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-862c8def-1987-47cc-bce4-6cc0a2637409 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.459s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:56 user nova-compute[75307]: INFO nova.compute.manager [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Rescuing
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lazy-loading 'flavor' on Instance uuid 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.106s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:57 user nova-compute[75307]: INFO nova.compute.manager [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Attaching volume 3d339e8c-225b-4c43-aeef-975ce31a946f to /dev/vdb
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.utils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c86aebf-e28e-43ec-98eb-0c8c90406c39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:57 user nova-compute[75307]: WARNING nova.compute.manager [req-c6371a26-313d-417a-aba0-d0f44c5a58e1 req-d6a04be9-2fd8-4a4a-a196-8e72d3f68f69 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state active and task_state rescuing.
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[606f7def-f8c9-40e6-a861-46cdeefdfb65]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a3e6b-f1ea-4d40-85e6-505cc4d151f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c07c29-080b-41c5-bad7-c064fa92590c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:15:57 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c53914a-eb0f-4ca2-8fdc-b364e0fbc5cf]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG os_brick.utils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating existing volume attachment record: 258f5af7-d188-4cfb-9b6e-f194f545aa0e {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance destroyed successfully.
Nov 13 23:15:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Attempting rescue
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:15:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Creating image(s)
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.344s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-changed-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Refreshing instance network info cache due to event network-changed-d6511cea-1a73-4612-bd4b-5a50bd96a3b1. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Refreshing network info cache for port d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue" returned: 0 in 0.053s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.401s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'migration_context' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.base [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<7ce8bbfc-ee12-48b0-85a4-8c7680502e6d> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start _get_guest_xml network_info=[{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f1:e9:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.base [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<7ce8bbfc-ee12-48b0-85a4-8c7680502e6d> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'numa_topology' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.base [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<7ce8bbfc-ee12-48b0-85a4-8c7680502e6d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:15:58 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:58 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.base [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<7ce8bbfc-ee12-48b0-85a4-8c7680502e6d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-540814245',display_name='tempest-ServerRescueNegativeTestJSON-server-540814245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-540814245',id=3,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-zop0x8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:23Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=7ce8bbfc-ee12-48b0-85a4-8c7680502e6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f1:e9:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f1:e9:5a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.objects.base [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<7ce8bbfc-ee12-48b0-85a4-8c7680502e6d> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:15:58 user nova-compute[75307]:   <uuid>7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</uuid>
Nov 13 23:15:58 user nova-compute[75307]:   <name>instance-00000003</name>
Nov 13 23:15:58 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:15:58 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:15:58 user nova-compute[75307]:   <metadata>
Nov 13 23:15:58 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:15:58 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-540814245</nova:name>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:15:58</nova:creationTime>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:15:58 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:15:58 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:owner>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:15:58 user nova-compute[75307]:       </nova:owner>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:15:58 user nova-compute[75307]:       <nova:ports>
Nov 13 23:15:58 user nova-compute[75307]:         <nova:port uuid="e7b19d21-b8a1-40c4-a576-1ac4f4276c4d">
Nov 13 23:15:58 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 23:15:58 user nova-compute[75307]:         </nova:port>
Nov 13 23:15:58 user nova-compute[75307]:       </nova:ports>
Nov 13 23:15:58 user nova-compute[75307]:     </nova:instance>
Nov 13 23:15:58 user nova-compute[75307]:   </metadata>
Nov 13 23:15:58 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:15:58 user nova-compute[75307]:     <system>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="serial">7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</entry>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="uuid">7ce8bbfc-ee12-48b0-85a4-8c7680502e6d</entry>
Nov 13 23:15:58 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:15:58 user nova-compute[75307]:     </system>
Nov 13 23:15:58 user nova-compute[75307]:   </sysinfo>
Nov 13 23:15:58 user nova-compute[75307]:   <os>
Nov 13 23:15:58 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:15:58 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:15:58 user nova-compute[75307]:   </os>
Nov 13 23:15:58 user nova-compute[75307]:   <features>
Nov 13 23:15:58 user nova-compute[75307]:     <acpi/>
Nov 13 23:15:58 user nova-compute[75307]:     <apic/>
Nov 13 23:15:58 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:15:58 user nova-compute[75307]:   </features>
Nov 13 23:15:58 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:15:58 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:15:58 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:15:58 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:15:58 user nova-compute[75307]:   </clock>
Nov 13 23:15:58 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:15:58 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:15:58 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:15:58 user nova-compute[75307]:   </cpu>
Nov 13 23:15:58 user nova-compute[75307]:   <devices>
Nov 13 23:15:58 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:15:58 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:15:58 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue"/>
Nov 13 23:15:58 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:15:58 user nova-compute[75307]:     </disk>
Nov 13 23:15:58 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:15:58 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:15:58 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk"/>
Nov 13 23:15:58 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:15:58 user nova-compute[75307]:     </disk>
Nov 13 23:15:58 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:15:58 user nova-compute[75307]:       <mac address="fa:16:3e:f1:e9:5a"/>
Nov 13 23:15:58 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:58 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:15:58 user nova-compute[75307]:       <target dev="tape7b19d21-b8"/>
Nov 13 23:15:58 user nova-compute[75307]:     </interface>
Nov 13 23:15:58 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:15:58 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/console.log" append="off"/>
Nov 13 23:15:58 user nova-compute[75307]:     </serial>
Nov 13 23:15:58 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:15:58 user nova-compute[75307]:     <video>
Nov 13 23:15:58 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:15:58 user nova-compute[75307]:     </video>
Nov 13 23:15:58 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:15:58 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:15:58 user nova-compute[75307]:     </rng>
Nov 13 23:15:58 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:15:58 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:15:58 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:15:58 user nova-compute[75307]:     </memballoon>
Nov 13 23:15:58 user nova-compute[75307]:   </devices>
Nov 13 23:15:58 user nova-compute[75307]: </domain>
Nov 13 23:15:58 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:15:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance destroyed successfully.
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:f1:e9:5a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updated VIF entry in instance network info cache for port d6511cea-1a73-4612-bd4b-5a50bd96a3b1. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:15:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd99c2bc-55b1-4620-9f6d-a90deb78ee60 req-7ecf2394-0a3d-4356-b923-e00a33b56768 service nova] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:15:59 user nova-compute[75307]: WARNING nova.compute.manager [req-f9e1fd55-8c30-4b99-b9d1-411c59ba0e87 req-0e49b2b3-342d-41db-93dc-fd73df413e4f service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state active and task_state rescuing.
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:15:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:00 user nova-compute[75307]: INFO nova.compute.manager [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Attaching volume 2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 to /dev/vdb
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.utils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c9196-2539-4e4f-a717-154935c56b7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b806ed7e-1041-4331-bee4-5cd125a57e2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[305b5eb7-72c9-4b31-833f-cf6301e66389]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[629661f5-24bf-4223-97f0-e71ce0002943]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:00 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[462ae4a6-6c33-4ca3-9e6f-b02f8f8e9807]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG os_brick.utils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:00 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating existing volume attachment record: 4ffab908-5f2a-4c6b-8cfb-5d0ded2917f7 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:01 user nova-compute[75307]: WARNING nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state active and task_state rescuing.
Nov 13 23:16:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:01 user nova-compute[75307]: WARNING nova.compute.manager [req-285a1865-0449-4f10-bd10-3eebe97ecaf4 req-3e80242f-c039-4320-8e51-c7e6b6fb24c9 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state active and task_state rescuing.
Nov 13 23:16:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9a8af431-61fe-4dc5-9834-d2fb89685c49 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQDuOMjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:02 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:02 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:02 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[724c78fb-cccc-4b7e-a82e-0da21489b123]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:02 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac60e25e-b7d8-41ba-95ed-cdf980a4746d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f] added
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca46ba8-ed91-4347-8c9c-ef52a6074d23]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a85963d-4082-45aa-b628-87a5a30df221]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQDuOMjS {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IQDuOMjS" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[47ae7cd9-cdaa-4b6b-a74a-4e2f61e6cc08]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IQDuOMjS'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b73645-b720-4dce-9272-d18c3fcc7922]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[329e1e7a-c530-4d96-b300-0ee936069a6b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[96dcb41a-92c6-415d-824e-f8c79ac089b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260]
Nov 13 23:16:02 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ad9334-0a9b-44ff-aaa0-9ed2e4d3222b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26aeb86-e172-43a1-9c0d-73e9c9d01f41]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:02 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] HCTL ('41', '-', '-', 0) found on session 10 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b77a05-8a2a-444c-ae1f-f9d09bbe0c04]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Searching for a device in session 10 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQDuOMjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '23935663032616233', 'path': '/dev/sdj'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935663032616233', 'path': '/dev/sdj'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lazy-loading 'flavor' on Instance uuid 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:04 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:04 user nova-compute[75307]:   <source dev="/dev/sdj"/>
Nov 13 23:16:04 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:04 user nova-compute[75307]:   <serial>3d339e8c-225b-4c43-aeef-975ce31a946f</serial>
Nov 13 23:16:04 user nova-compute[75307]: </disk>
Nov 13 23:16:04 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] No VIF found with MAC fa:16:3e:96:9b:c3, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ff6a8c77-8dfa-4df8-bc86-465009a3d898 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.481s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:05 user nova-compute[75307]: INFO nova.compute.manager [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Terminating instance
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:05 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5c266a-43f0-4a69-9e07-c4f21c979752]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:05 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc0ae9-27fd-479e-9d53-966374e28908]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3] added
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f562d-3ec7-481f-9597-5336ea42d626]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b415add-f4bb-4d55-a2a7-908332b628c3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOsiBCvZ {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOsiBCvZ" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43c2dfd-1793-4943-8f32-8f49429bd6dc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOsiBCvZ'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-unplugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] No waiting events found dispatching network-vif-unplugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-0c45da21-175a-4b94-b490-ad2f96b75572 req-7f64dd01-a368-4807-b7ee-7b9358f48d0e service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-unplugged-5f82b533-de1e-4842-b541-7e0532d95fec for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8599e375-639b-48bd-b10f-4b852a8a41d4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c00fae3-f453-447b-94c7-48c60e9fb3d1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827904f-f192-4650-8d2e-aea654ed1b8b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]
Nov 13 23:16:05 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08f2642-bf37-493e-8ba3-8be5be373e96]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adfb21a-eabe-40c2-b436-7f3428c01ad3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.415s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] HCTL ('42', '-', '-', 0) found on session 11 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b8c966-4bfa-459c-b8f1-80d5684efef3]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 11 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:05 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Instance destroyed successfully.
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lazy-loading 'resources' on Instance uuid 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-320323385',display_name='tempest-DeleteServersTestJSON-server-320323385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-320323385',id=1,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2a08b833bbe4103bed42ccb1d064846',ramdisk_id='',reservation_id='r-33wggj0l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1666613041',owner_user_name='tempest-DeleteServersTestJSON-1666613041-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:23Z,user_data=None,user_id='9c06379bf565487284e596dceed5d8f8',uuid=3fdb8e80-ade5-46d2-9d88-aa41d93c2a60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converting VIF {"id": "5f82b533-de1e-4842-b541-7e0532d95fec", "address": "fa:16:3e:96:9b:c3", "network": {"id": "18dddda9-56c2-4aa5-995c-94ee991ea230", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-882479423-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2a08b833bbe4103bed42ccb1d064846", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f82b533-de", "ovs_interfaceid": "5f82b533-de1e-4842-b541-7e0532d95fec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_vif [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f82b533-de, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d9df6e00-9bb6-4789-9e2f-a51568630344) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:05 user nova-compute[75307]: INFO os_vif [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:9b:c3,bridge_name='br-int',has_traffic_filtering=True,id=5f82b533-de1e-4842-b541-7e0532d95fec,network=Network(18dddda9-56c2-4aa5-995c-94ee991ea230),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f82b533-de')
Nov 13 23:16:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IQDuOMjS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== connect_volume: return (1471ms) {'type': 'block', 'scsi_wwn': '23530383166306633', 'path': '/dev/sdk'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530383166306633', 'path': '/dev/sdk'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.784s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[54caf950-4eb2-404e-9544-03c833d36e17]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:06 user nova-compute[75307]: No targets found.
Nov 13 23:16:06 user nova-compute[75307]: iSNS:
Nov 13 23:16:06 user nova-compute[75307]: No targets found.
Nov 13 23:16:06 user nova-compute[75307]: STATIC:
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:06 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:06 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:06 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:06 user nova-compute[75307]: No targets found.
Nov 13 23:16:06 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:06 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:06 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:06 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:06 user nova-compute[75307]:   <source dev="/dev/sdk"/>
Nov 13 23:16:06 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:06 user nova-compute[75307]:   <serial>2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3</serial>
Nov 13 23:16:06 user nova-compute[75307]: </disk>
Nov 13 23:16:06 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8596ff5c-0677-479b-8d7d-826e18252a45]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18ca308-6f5c-4621-aed5-7bef07331025]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:06 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c0d2f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f'): ({'sdj'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Removing single pathed devices sdj {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[61655eb4-9f1e-4138-9026-6b3a903299f9]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80a049a-eab7-4ba3-853b-33862ffab9e0]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Flushing IO for device /dev/sdj {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee94b41-d3a2-4c52-92b4-be26bd8ac129]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.053s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7389ee9a-37a5-4d52-9299-a8bec84aefe0]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] SCSI volumes sdj have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458c24c-1ab3-4371-a7ce-4b10270535f3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[673b8b76-a9fa-48e2-b17d-9c235f217834]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260]
Nov 13 23:16:07 user nova-compute[75307]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d339e8c-225b-4c43-aeef-975ce31a946f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecb9c66-d6d2-4025-aea0-c23531cfe266]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] <== disconnect_volume: return (1202ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Deleting instance files /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60_del
Nov 13 23:16:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Deletion of /opt/stack/data/nova/instances/3fdb8e80-ade5-46d2-9d88-aa41d93c2a60_del complete
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No VIF found with MAC fa:16:3e:7a:10:97, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75307) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 13 23:16:07 user nova-compute[75307]: INFO nova.virt.libvirt.host [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] UEFI support detected
Nov 13 23:16:07 user nova-compute[75307]: INFO nova.compute.manager [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Took 2.24 seconds to destroy the instance on the hypervisor.
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f1c95-84bb-4e54-a623-1b86f824eb39 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.980s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] Acquiring lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] No waiting events found dispatching network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:07 user nova-compute[75307]: WARNING nova.compute.manager [req-d018db93-85a7-49e7-9506-bf74d13fe5bd req-954ca802-b3fd-4dd2-b440-949c8fb2479d service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received unexpected event network-vif-plugged-5f82b533-de1e-4842-b541-7e0532d95fec for instance with vm_state active and task_state deleting.
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:07 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '3fdb8e80-ade5-46d2-9d88-aa41d93c2a60' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '3fdb8e80-ade5-46d2-9d88-aa41d93c2a60' (instance-00000001)
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-72fc60b6-d31c-4b5b-9af9-5e63951b5314 req-227ca1a5-5f82-402d-99ac-2947be5aeb6c service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Received event network-vif-deleted-5f82b533-de1e-4842-b541-7e0532d95fec {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:08 user nova-compute[75307]: INFO nova.compute.manager [req-72fc60b6-d31c-4b5b-9af9-5e63951b5314 req-227ca1a5-5f82-402d-99ac-2947be5aeb6c service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Neutron deleted interface 5f82b533-de1e-4842-b541-7e0532d95fec; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.network.neutron [req-72fc60b6-d31c-4b5b-9af9-5e63951b5314 req-227ca1a5-5f82-402d-99ac-2947be5aeb6c service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:08 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:16:08 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=6684MB free_disk=25.537376403808594GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:16:08 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Took 1.23 seconds to deallocate network for instance.
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75307) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-72fc60b6-d31c-4b5b-9af9-5e63951b5314 req-227ca1a5-5f82-402d-99ac-2947be5aeb6c service nova] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Detach interface failed, port_id=5f82b533-de1e-4842-b541-7e0532d95fec, reason: Instance 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 0f67a3a3-418a-4287-b639-8b285caaf4ec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e1e6da31-8158-4824-956b-c3f619dd06b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 88f67d93-784c-4a3c-950a-f018df17dbf9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9bae8cbf-0579-46ec-b459-fa47c43efe8e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.633s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance destroyed successfully.
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0f20811e-9a22-481f-96c4-def546dccf61 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.866s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:09 user nova-compute[75307]: INFO nova.compute.manager [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] [instance: 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60] Took 0.87 seconds to detach 1 volumes for instance.
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:09 user nova-compute[75307]: WARNING nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:09 user nova-compute[75307]: WARNING nova.compute.manager [req-e9694bf0-2a2a-4677-9c0c-57ebed1c014f req-30a9d289-2565-4237-8ccc-78f4b9d8ef9f service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:09 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Deleted allocations for instance 3fdb8e80-ade5-46d2-9d88-aa41d93c2a60
Nov 13 23:16:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b19aa2b4-338a-482d-bc0a-e60fce4f9783 tempest-DeleteServersTestJSON-1666613041 tempest-DeleteServersTestJSON-1666613041-project-member] Lock "3fdb8e80-ade5-46d2-9d88-aa41d93c2a60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.921s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-changed-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Refreshing instance network info cache due to event network-changed-3328c69f-165f-461b-93c1-20059eb97c33. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] Acquiring lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] Acquired lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Refreshing network info cache for port 3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updated VIF entry in instance network info cache for port 3328c69f-165f-461b-93c1-20059eb97c33. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating instance_info_cache with network_info: [{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1bd072ab-a2b5-4c24-87eb-769e97fbf4bb req-4d1c01f1-7857-4041-92b9-38d3af1328ae service nova] Releasing lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG nova.objects.instance [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'flavor' on Instance uuid ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-changed-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Refreshing instance network info cache due to event network-changed-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] Acquiring lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] Acquired lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Refreshing network info cache for port dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:19 user nova-compute[75307]: INFO nova.compute.manager [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Attaching volume 8f372524-699c-46fb-9ecd-a9b1adb60185 to /dev/vdb
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.utils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e6e40-3046-4f36-95c0-f3dfc0a06309]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f52399d-09b0-49eb-ba37-9639fea8181d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[965c3dbc-5b96-4870-86da-ce29724a2868]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07503a-387d-4e98-85f2-8662444a6ae5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:19 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda32993-087e-4985-b6e7-1f0c46338bf7]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG os_brick.utils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:19 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating existing volume attachment record: a2d15390-2866-44b1-aebf-8b2e21fb9301 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-changed-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing instance network info cache due to event network-changed-fb7cdb1d-f098-4652-af97-d7ad34850018. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing network info cache for port fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updated VIF entry in instance network info cache for port dd6f1e80-dce1-4984-9458-d1dd8cd0cab2. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating instance_info_cache with network_info: [{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d22e8ed9-af6f-4553-ab60-f2f1fb5214cd req-9c2f8a4c-f7a6-4251-9ec0-b25365f94e27 service nova] Releasing lock "refresh_cache-f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updated VIF entry in instance network info cache for port fb7cdb1d-f098-4652-af97-d7ad34850018. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-47a3e4bb-eacb-40c3-9f5b-c063398baac9 req-fb95c247-3f9d-4b74-aa97-9f7f928be71f service nova] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'pci_requests' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Object Instance<9ad3fd32-a8f8-48aa-a198-13bd6bf20caa> lazy-loaded attributes: flavor,pci_requests {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:16:20 user nova-compute[75307]: INFO nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Rebuilding instance
Nov 13 23:16:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.policy [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ade1329f384250a9d4bfb46663af88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb004021b8aa4795b049ebad0d119f84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:16:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-unplugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No waiting events found dispatching network-vif-unplugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:21 user nova-compute[75307]: WARNING nova.compute.manager [req-abe200ee-ae20-4c8f-9724-6b531d9eaed6 req-a74443b4-142c-4d55-8bd4-5dce73a0afc8 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-unplugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state active and task_state rebuilding.
Nov 13 23:16:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance destroyed successfully.
Nov 13 23:16:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance destroyed successfully.
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899693339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:16:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd6f1e80-dc, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6e3658d5-11dd-4ae2-86ff-0f9b05975bec) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:21 user nova-compute[75307]: INFO os_vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc')
Nov 13 23:16:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[58330bce-13ec-4614-a773-7aaf48d14f34]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:21 user nova-compute[75307]: No targets found.
Nov 13 23:16:21 user nova-compute[75307]: iSNS:
Nov 13 23:16:21 user nova-compute[75307]: No targets found.
Nov 13 23:16:21 user nova-compute[75307]: STATIC:
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:21 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:21 user nova-compute[75307]: No targets found.
Nov 13 23:16:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:21 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:21 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f948262-cc00-407f-843c-481ad5e7a34a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae3eedfd-da12-4330-a104-6459dcb331c3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c11a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b039ce5-5b1f-4c8c-8f1f-1c55229cc15e]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33245e1-e385-4b4c-a8cd-49e7e58b5b91]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc668d1a-374f-4236-b792-874515e7f368]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.067s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a2819a-8b15-442d-a52b-76b424cf6844]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a653813e', '/dev/disk/by-id/scsi-26561623862653431', '/dev/disk/by-id/scsi-1SCST_BIOa653813e-eab8be410768be2d') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:16:22 user nova-compute[75307]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_a653813e
Nov 13 23:16:22 user nova-compute[75307]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26561623862653431
Nov 13 23:16:22 user nova-compute[75307]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOa653813e-eab8be410768be2d
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fd992e-9ae4-439a-a04f-5965a68d5d87]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[010c9a87-f5b9-4f9c-a87a-a64dad1f40c6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Successfully created port: bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2961af90-3ddb-4334-9863-052260d8190c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]
Nov 13 23:16:22 user nova-compute[75307]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b5534b-6c4c-4059-87bc-3e60e9194a33]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== disconnect_volume: return (469ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deleting instance files /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77_del
Nov 13 23:16:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deletion of /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77_del complete
Nov 13 23:16:22 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 could not be found.
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f641f-39ee-489b-a512-32cdf508c40c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:22 user nova-compute[75307]: No targets found.
Nov 13 23:16:22 user nova-compute[75307]: iSNS:
Nov 13 23:16:22 user nova-compute[75307]: No targets found.
Nov 13 23:16:22 user nova-compute[75307]: STATIC:
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:22 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:22 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:22 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:22 user nova-compute[75307]: No targets found.
Nov 13 23:16:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:22 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:22 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[467c6034-6e4d-4374-9ea8-4eb6152339cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcff611-3f7d-42ef-8d1d-0fb39e710b5a]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c11ba30>, {}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Disconnecting from: [] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.087s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== disconnect_volume: return (88ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Successfully updated port: bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Preparing to wait for external event volume-reimaged-bb0cf1e3-92ed-43bd-902d-617253af6522 {{(pid=75307) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG os_vif [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '725f5a15-a1cd-5704-9e26-a67acad5cf61', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbb849627-f5, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbb849627-f5, col_values=(('qos', UUID('dfeabf29-f696-410a-8fc6-e6fd30136da8')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbb849627-f5, col_values=(('external_ids', {'iface-id': 'bb849627-f5fa-43f2-b070-1a5ec11a4d08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:e1:e3', 'vm-uuid': '9ad3fd32-a8f8-48aa-a198-13bd6bf20caa'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: INFO os_vif [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5')
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] attach device xml: <interface type="ethernet">
Nov 13 23:16:23 user nova-compute[75307]:   <mac address="fa:16:3e:d5:e1:e3"/>
Nov 13 23:16:23 user nova-compute[75307]:   <model type="virtio"/>
Nov 13 23:16:23 user nova-compute[75307]:   <mtu size="1442"/>
Nov 13 23:16:23 user nova-compute[75307]:   <target dev="tapbb849627-f5"/>
Nov 13 23:16:23 user nova-compute[75307]: </interface>
Nov 13 23:16:23 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No event matching network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 in dict_keys([('volume-reimaged', 'bb0cf1e3-92ed-43bd-902d-617253af6522')]) {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 13 23:16:23 user nova-compute[75307]: WARNING nova.compute.manager [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state active and task_state rebuilding.
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-changed-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing instance network info cache due to event network-changed-bb849627-f5fa-43f2-b070-1a5ec11a4d08. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Refreshing network info cache for port bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name hda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No VIF found with MAC fa:16:3e:8a:94:82, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:24 user nova-compute[75307]: WARNING nova.compute.manager [req-81a23f63-4a4e-4fca-9cc5-163acbe40ed8 req-abd15cbe-59ef-4539-8968-7491ba657754 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 for instance with vm_state active and task_state None.
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:16:24 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:16:24</nova:creationTime>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:16:24 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:16:24 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:owner>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:16:24 user nova-compute[75307]:   </nova:owner>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:16:24 user nova-compute[75307]:   <nova:ports>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:16:24 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:16:24 user nova-compute[75307]:     </nova:port>
Nov 13 23:16:24 user nova-compute[75307]:     <nova:port uuid="bb849627-f5fa-43f2-b070-1a5ec11a4d08">
Nov 13 23:16:24 user nova-compute[75307]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 13 23:16:24 user nova-compute[75307]:     </nova:port>
Nov 13 23:16:24 user nova-compute[75307]:   </nova:ports>
Nov 13 23:16:24 user nova-compute[75307]: </nova:instance>
Nov 13 23:16:24 user nova-compute[75307]:  {{(pid=75307) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29af2000-9ad6-48e9-8dda-5ecbc9740b7e tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.797s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIVuZczT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:24 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:24 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:24 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b62274-6529-4374-8a58-6db832ccc9df]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:24 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3d73e8-33b3-4550-925a-97fc714c863a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185] added
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updated VIF entry in instance network info cache for port bb849627-f5fa-43f2-b070-1a5ec11a4d08. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[05192b41-6874-4cef-92cb-32084ff30f93]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a1c949a9-f8e6-435a-bff2-3d5d11f29ebf req-94b49df4-4f29-4613-8f65-b83ed5d3c0cb service nova] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29d4e09-e2b9-4d71-a272-8582b2f20896]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIVuZczT {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yIVuZczT" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[215ce453-4100-4169-8d55-6fbec9e0fb30]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yIVuZczT'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[485a1603-5719-4906-b9c6-655cd50d3e5f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68344ff-3309-45b9-aa43-a7e8c69a6938]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c56aa5-e466-4971-b0d5-351a66fb3c39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260]
Nov 13 23:16:24 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[17edc7ef-6280-46aa-a5c6-64e1b8be8578]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cebbf3e-6b7f-4aaf-b7c1-abcda6e77f0e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:24 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.373s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[384ed3ce-fd6f-49b7-a46d-ebb35720f9a7]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIVuZczT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.objects.instance [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:25 user nova-compute[75307]: INFO nova.compute.manager [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Attaching volume a1accccb-5437-4867-9260-5965cb4a1aa6 to /dev/vdb
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0750e03-824f-47ae-9aaf-0455f8f1d84b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13e7c9f-bcbf-4988-bb29-0c863c255d2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d9177c-2718-4a05-8500-cf210403ba02]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2075eb-1363-4783-89f9-5296fd9983d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:25 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4850b0-cee2-44cc-958e-a43fd83a91d3]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating existing volume attachment record: 2a915914-f5d0-4613-8e82-c60acfb0d4b7 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-changed-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Refreshing instance network info cache due to event network-changed-0afdfdfa-53d3-46a5-90ad-d65ec1547664. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] Acquiring lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] Acquired lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Refreshing network info cache for port 0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.409s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '23236376465653261', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236376465653261', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.objects.instance [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'flavor' on Instance uuid ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:25 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:25 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:16:25 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:25 user nova-compute[75307]:   <serial>8f372524-699c-46fb-9ecd-a9b1adb60185</serial>
Nov 13 23:16:25 user nova-compute[75307]: </disk>
Nov 13 23:16:25 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lazy-loading 'flavor' on Instance uuid 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:26 user nova-compute[75307]: INFO nova.compute.manager [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Attaching volume 53ab6ef8-0642-42da-b000-cab42ac0100b to /dev/sdc
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.utils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updated VIF entry in instance network info cache for port 0afdfdfa-53d3-46a5-90ad-d65ec1547664. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updating instance_info_cache with network_info: [{"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5714b35-cd93-49f6-bc42-07132d6e8343]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-77164930-c9ed-4a76-94ab-fed01a588be1 req-73836ebf-98c4-4c7a-b39b-96c500f7b063 service nova] Releasing lock "refresh_cache-0f67a3a3-418a-4287-b639-8b285caaf4ec" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8eb449-add7-46a4-b762-fef67d9d3801]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:26 user nova-compute[75307]: WARNING nova.compute.manager [req-2d80cb19-ee78-4ddf-b66d-2659eb5f198e req-86a1b37a-b6b1-4f36-9f97-5ff5f63e2742 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 for instance with vm_state active and task_state None.
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[daba2f61-21c3-42ac-8a2d-16f8176a17ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e475c37-1680-4a74-a506-1358b6d93233]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:26 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c9b9d0-1cba-433b-98f7-cc69fb74dbe3]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG os_brick.utils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updating existing volume attachment record: 44ba9ead-49fd-49f6-b879-f93e1d4b792d {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No VIF found with MAC fa:16:3e:40:ca:4a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-400aa398-f82d-4678-ae04-9e9be3fcdf84 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.025s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:28 user nova-compute[75307]: INFO nova.compute.manager [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Detaching volume 8f372524-699c-46fb-9ecd-a9b1adb60185
Nov 13 23:16:28 user nova-compute[75307]: INFO nova.virt.block_device [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Attempting to driver detach volume 8f372524-699c-46fb-9ecd-a9b1adb60185 from mountpoint /dev/vdb
Nov 13 23:16:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Attempting to detach device vdb from instance ea05ed6f-d9fa-4393-beb6-569f50defea6 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:28 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:28 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:16:28 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:28 user nova-compute[75307]:   <serial>8f372524-699c-46fb-9ecd-a9b1adb60185</serial>
Nov 13 23:16:28 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:16:28 user nova-compute[75307]: </disk>
Nov 13 23:16:28 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully detached device vdb from instance ea05ed6f-d9fa-4393-beb6-569f50defea6 from the persistent domain config.
Nov 13 23:16:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ea05ed6f-d9fa-4393-beb6-569f50defea6 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:28 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:28 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:16:28 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:28 user nova-compute[75307]:   <serial>8f372524-699c-46fb-9ecd-a9b1adb60185</serial>
Nov 13 23:16:28 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:16:28 user nova-compute[75307]: </disk>
Nov 13 23:16:28 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:16:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFBCOLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:30 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f800323f-eda8-41cc-9544-3ef372be5e65]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:30 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[59613a84-4623-4f5e-b3df-2452e01c4258]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6] added
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc90dc49-31f0-4498-9ea7-1e76842839dd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16291e0-3bdd-4d71-bf5c-28c8ed41e65c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFBCOLzK {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YFBCOLzK" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3fbd31c-0bba-419e-8e2a-317bde8e4f1e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YFBCOLzK'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f280f82c-316d-4f12-b247-be00cf175d26]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b40647d-cb18-4882-b82c-f291cebc18fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b956999-501a-4537-ae4d-5bd5e567cd61]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260]
Nov 13 23:16:30 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[568d3b22-fad3-41b9-8667-a88b15887455]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[260a521a-00c7-4a5b-83dc-487de7439eb3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] HCTL ('43', '-', '-', 0) found on session 14 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Scanning host 43 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7e5a8f-128d-4e48-9254-5c27c92b5692]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Searching for a device in session 14 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFBCOLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXkqSWEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23531393363323966', 'path': '/dev/sdl'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23531393363323966', 'path': '/dev/sdl'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.763s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:31 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:31 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3229722-a8a1-4530-97aa-c7e9cdf4a753]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:31 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:31 user nova-compute[75307]:   <source dev="/dev/sdl"/>
Nov 13 23:16:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:31 user nova-compute[75307]:   <serial>a1accccb-5437-4867-9260-5965cb4a1aa6</serial>
Nov 13 23:16:31 user nova-compute[75307]: </disk>
Nov 13 23:16:31 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8bee2-91cf-4b8d-ab52-2be1c34d3fda]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b] added
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d7ec01-31a6-4852-b70e-4957eb441891]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac7e1d0-832a-4e6a-b0d7-99f7098b5ff2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXkqSWEZ {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXkqSWEZ" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0499a75-3db0-4ff7-b8eb-c653c58585d1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXkqSWEZ'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f86f9c5-73ce-4e05-ad6e-3bb9cd1b46e0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0022ba-49d8-4d5f-8551-01e0d029de5f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --login" returned: 0 in 0.113s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8aa419-80f2-48bf-8f36-96a709f4f8b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260]
Nov 13 23:16:31 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a42ef-0a59-4f3f-a7ec-900efba895d7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[635682fa-2c1b-46da-a3c5-9ed5ba7fc63c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] HCTL ('44', '-', '-', 0) found on session 15 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Scanning host 44 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host44/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host44/scan" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d71943c-f02d-4ddd-a2a9-054500c15764]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Searching for a device in session 15 and hctl ['44', '*', '*', 0] yield: sdm {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Connected to sdm using {'target_iqn': 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXkqSWEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No BDM found with device name hda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] No VIF found with MAC fa:16:3e:8a:94:82, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-01587813-73fd-40b1-b70b-6bf8aeaea5f0 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.614s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] <== connect_volume: return (2200ms) {'type': 'block', 'scsi_wwn': '26363363735323231', 'path': '/dev/sdm'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363363735323231', 'path': '/dev/sdm'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lazy-loading 'flavor' on Instance uuid 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:32 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:32 user nova-compute[75307]:   <source dev="/dev/sdm"/>
Nov 13 23:16:32 user nova-compute[75307]:   <target dev="sdc" bus="scsi"/>
Nov 13 23:16:32 user nova-compute[75307]:   <serial>53ab6ef8-0642-42da-b000-cab42ac0100b</serial>
Nov 13 23:16:32 user nova-compute[75307]:   <address type="drive" controller="0" unit="2"/>
Nov 13 23:16:32 user nova-compute[75307]: </disk>
Nov 13 23:16:32 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No BDM found with device name sda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] No VIF found with MAC fa:16:3e:c6:ff:eb, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4b76e21c-2817-4beb-aff0-04e68025f4ca tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.697s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:33 user nova-compute[75307]: INFO nova.compute.manager [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Detaching volume a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:34 user nova-compute[75307]: INFO nova.virt.block_device [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Attempting to driver detach volume a1accccb-5437-4867-9260-5965cb4a1aa6 from mountpoint /dev/vdb
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Attempting to detach device vdb from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:34 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:34 user nova-compute[75307]:   <source dev="/dev/sdl"/>
Nov 13 23:16:34 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:34 user nova-compute[75307]:   <serial>a1accccb-5437-4867-9260-5965cb4a1aa6</serial>
Nov 13 23:16:34 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:16:34 user nova-compute[75307]: </disk>
Nov 13 23:16:34 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully detached device vdb from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the persistent domain config.
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:34 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:34 user nova-compute[75307]:   <source dev="/dev/sdl"/>
Nov 13 23:16:34 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:34 user nova-compute[75307]:   <serial>a1accccb-5437-4867-9260-5965cb4a1aa6</serial>
Nov 13 23:16:34 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:16:34 user nova-compute[75307]: </disk>
Nov 13 23:16:34 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-changed-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Refreshing instance network info cache due to event network-changed-800034b9-e021-423d-baea-389a08093ef6. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] Acquiring lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] Acquired lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Refreshing network info cache for port 800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lazy-loading 'flavor' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.086s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:34 user nova-compute[75307]: INFO nova.compute.manager [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Attaching volume c8d3ee99-43ff-4c8f-9096-8e0d525d1552 to /dev/vdb
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updated VIF entry in instance network info cache for port 800034b9-e021-423d-baea-389a08093ef6. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating instance_info_cache with network_info: [{"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f651529d-1cf1-40bc-82d1-3685f805e6c8 req-a6615575-1b3a-44ba-862b-64c41330507c service nova] Releasing lock "refresh_cache-e1e6da31-8158-4824-956b-c3f619dd06b4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG os_brick.utils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b98f1e-99ab-4bfe-b456-694b54406d1b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b89e777-38dc-49d0-b3bb-d1642bdb2a2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[01699b57-2b8e-4b4c-9fb7-4b3968eb1cac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c437b6-7c84-419a-900f-0911f8a1da04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:35 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:35 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9ce405-3cfa-4b38-9917-815c3aae56c1]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG os_brick.utils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating existing volume attachment record: 67318d8b-63c1-4b98-963c-50a070054ab8 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:35 user nova-compute[75307]: INFO nova.compute.manager [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Detaching volume 53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:35 user nova-compute[75307]: INFO nova.virt.block_device [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Attempting to driver detach volume 53ab6ef8-0642-42da-b000-cab42ac0100b from mountpoint /dev/sdc
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Attempting to detach device sdc from instance 0f67a3a3-418a-4287-b639-8b285caaf4ec from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:35 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:35 user nova-compute[75307]:   <source dev="/dev/sdm"/>
Nov 13 23:16:35 user nova-compute[75307]:   <target dev="sdc" bus="scsi"/>
Nov 13 23:16:35 user nova-compute[75307]:   <serial>53ab6ef8-0642-42da-b000-cab42ac0100b</serial>
Nov 13 23:16:35 user nova-compute[75307]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 23:16:35 user nova-compute[75307]: </disk>
Nov 13 23:16:35 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Successfully detached device sdc from instance 0f67a3a3-418a-4287-b639-8b285caaf4ec from the persistent domain config.
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0f67a3a3-418a-4287-b639-8b285caaf4ec from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:35 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:35 user nova-compute[75307]:   <source dev="/dev/sdm"/>
Nov 13 23:16:35 user nova-compute[75307]:   <target dev="sdc" bus="scsi"/>
Nov 13 23:16:35 user nova-compute[75307]:   <serial>53ab6ef8-0642-42da-b000-cab42ac0100b</serial>
Nov 13 23:16:35 user nova-compute[75307]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 13 23:16:35 user nova-compute[75307]: </disk>
Nov 13 23:16:35 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-132aa086-a9c8-4297-9f69-f26dc30e36bc req-950c63b8-84f4-41dd-ae54-a4275a8c2e3a service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event volume-reimaged-bb0cf1e3-92ed-43bd-902d-617253af6522 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-132aa086-a9c8-4297-9f69-f26dc30e36bc req-950c63b8-84f4-41dd-ae54-a4275a8c2e3a service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-132aa086-a9c8-4297-9f69-f26dc30e36bc req-950c63b8-84f4-41dd-ae54-a4275a8c2e3a service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-132aa086-a9c8-4297-9f69-f26dc30e36bc req-950c63b8-84f4-41dd-ae54-a4275a8c2e3a service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-132aa086-a9c8-4297-9f69-f26dc30e36bc req-950c63b8-84f4-41dd-ae54-a4275a8c2e3a service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Processing event volume-reimaged-bb0cf1e3-92ed-43bd-902d-617253af6522 {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance event wait completed in 13 seconds for volume-reimaged {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:16:36 user nova-compute[75307]: INFO nova.virt.block_device [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Booting with volume bb0cf1e3-92ed-43bd-902d-617253af6522 at /dev/vda
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.utils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ea8cbe-e959-4c5d-b616-da9a738e80d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc46c80b-4e7e-4a9f-91a5-05257b7de53c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc2d420-a7d9-4eef-8659-978ba007b035]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38dcd1c-34aa-4bd5-b960-866a69a4d37a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:16:36 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:16:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed59700-ef92-4762-8ed4-6ab125d4af0c]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG os_brick.utils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:36 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating existing volume attachment record: 55597757-1ab3-4b73-879d-f88c6a61322e {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:16:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozpEthAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:39 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:39 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:39 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c1aa81-01f9-45a0-9d24-1a6498dd1ba7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:39 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecdd6aef-b87e-4549-97d8-d3fe8b061482]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552] added
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a41b28f-2d7b-47c6-8266-2e544aa7ee7e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c287935b-d236-4e87-9758-f56da77ec527]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozpEthAc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ozpEthAc" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec30aafd-712b-4e0d-9ee9-daed2bd34725]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ozpEthAc'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bf8a13-24e7-4eac-adcb-f9973e8b7a1b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4a348a-2620-439f-893c-d286446f3c72]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --login" returned: 0 in 0.100s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c777b5a-9b24-4214-acfc-e771ee18efe8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260]
Nov 13 23:16:39 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[946e0090-7c9d-4f9b-af8b-168717a4672b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7328ca-2cf3-428b-b2a9-adaf6a0eeb7f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:39 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] HCTL ('41', '-', '-', 0) found on session 16 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68b5c6fb-40b3-4e51-ad8c-a4541f67bc8c]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Searching for a device in session 16 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozpEthAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26563663162366537', 'path': '/dev/sdj'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563663162366537', 'path': '/dev/sdj'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lazy-loading 'flavor' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] attach device xml: <disk type="block" device="disk">
Nov 13 23:16:40 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:40 user nova-compute[75307]:   <source dev="/dev/sdj"/>
Nov 13 23:16:40 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:40 user nova-compute[75307]:   <serial>c8d3ee99-43ff-4c8f-9096-8e0d525d1552</serial>
Nov 13 23:16:40 user nova-compute[75307]: </disk>
Nov 13 23:16:40 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] No VIF found with MAC fa:16:3e:cc:6a:6c, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-06436596-2ffc-49bc-9687-cdc10f4897b5 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.433s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:16:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Creating image(s)
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Ensure instance console log exists: /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start _get_guest_xml network_info=[{"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f700766b-4cb7-4eb9-a0b4-62e2c9c33a77', 'attached_at': '', 'detached_at': '', 'volume_id': 'bb0cf1e3-92ed-43bd-902d-617253af6522', 'serial': 'bb0cf1e3-92ed-43bd-902d-617253af6522'}, 'delete_on_termination': True, 'attachment_id': '55597757-1ab3-4b73-879d-f88c6a61322e', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:16:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 23:16:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.objects.instance [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lazy-loading 'vcpu_model' on Instance uuid f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:41 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9b51ba-ef55-460d-b47a-b4f37c7de59e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:16:41 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1389a2d-ab2d-480a-ac55-f99e6dcccb12]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522] added
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979a063-60ec-472b-ae07-806f7637bedb]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3764f49c-3a34-4590-990c-2e5ca0666022]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeFrUcYt {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zeFrUcYt" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef9192b-f329-417a-b93e-2bfb66a204af]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zeFrUcYt'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11c7ac9-4fff-4dea-8949-0831bdcc6ee8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9fdf34-347d-4ac2-8f2b-43e069b47610]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --login" returned: 0 in 0.140s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34216b4-c297-47e2-9264-60b2dbc63e6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]
Nov 13 23:16:41 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49cdd20-2ee1-40b1-90c8-74810e3f25f6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d6bb2b-ba90-4c4a-8b86-8c14d4655358]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] HCTL ('45', '-', '-', 0) found on session 17 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Scanning host 45 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host45/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host45/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bedac9-0daa-43f0-b819-5ae1edada4a6]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Searching for a device in session 17 and hctl ['45', '*', '*', 0] yield: sdn {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:16:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Connected to sdn using {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] volume_snapshot_create: create_info: {'snapshot_id': '3851ac0b-15f0-4bbc-b33e-6444b5e9f0a5', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75307) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] snap xml: <domainsnapshot>
Nov 13 23:16:42 user nova-compute[75307]:   <disks>
Nov 13 23:16:42 user nova-compute[75307]:     <disk name="/dev/sdj" snapshot="external" type="file">
Nov 13 23:16:42 user nova-compute[75307]:       <source file="/dev/new_file"/>
Nov 13 23:16:42 user nova-compute[75307]:     </disk>
Nov 13 23:16:42 user nova-compute[75307]:     <disk name="vda" snapshot="no"/>
Nov 13 23:16:42 user nova-compute[75307]:   </disks>
Nov 13 23:16:42 user nova-compute[75307]: </domainsnapshot>
Nov 13 23:16:42 user nova-compute[75307]:  {{(pid=75307) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] Lazy-loading 'system_metadata' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:42 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     rv = execute(f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     six.reraise(c, e, tb)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     raise value
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     rv = meth(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     self._volume_snapshot_create(context, instance, guest,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     rv = execute(f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     six.reraise(c, e, tb)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     raise value
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     rv = meth(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] 
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1605ca9f-6ace-4156-9697-fa9a055a67b6 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] volume_snapshot_delete: delete_info: {'volume_id': 'c8d3ee99-43ff-4c8f-9096-8e0d525d1552'} {{(pid=75307) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [None req-1605ca9f-6ace-4156-9697-fa9a055a67b6 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4]     if delete_info['type'] != 'qcow2':
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] KeyError: 'type'
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 3851ac0b-15f0-4bbc-b33e-6444b5e9f0a5 could not be found.
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise value
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 3851ac0b-15f0-4bbc-b33e-6444b5e9f0a5 could not be found. (HTTP 404) (Request-ID: req-6d0fe645-cc22-48a8-a83d-e76fecc8152c)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 3851ac0b-15f0-4bbc-b33e-6444b5e9f0a5 could not be found.
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver [None req-1605ca9f-6ace-4156-9697-fa9a055a67b6 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e2c3cd49-420f-4025-bde9-1cedee69fadf)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 13 23:16:42 user nova-compute[75307]: ERROR nova.virt.libvirt.driver 
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server [None req-9b822c85-74b8-4c19-a275-a5e2896a3873 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise value
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server 
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server [None req-1605ca9f-6ace-4156-9697-fa9a055a67b6 tempest-VolumesAssistedSnapshotsTest-490113750 tempest-VolumesAssistedSnapshotsTest-490113750-project] Exception during message handling: KeyError: 'type'
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 13 23:16:42 user nova-compute[75307]: ERROR oslo_messaging.rpc.server 
Nov 13 23:16:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== connect_volume: return (1446ms) {'type': 'block', 'scsi_wwn': '26561623862653431', 'path': '/dev/sdn'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561623862653431', 'path': '/dev/sdn'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899693339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:16:42 user nova-compute[75307]:   <uuid>f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</uuid>
Nov 13 23:16:42 user nova-compute[75307]:   <name>instance-00000006</name>
Nov 13 23:16:42 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:16:42 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:16:42 user nova-compute[75307]:   <metadata>
Nov 13 23:16:42 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:16:42 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:16:42 user nova-compute[75307]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1899693339</nova:name>
Nov 13 23:16:42 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:16:41</nova:creationTime>
Nov 13 23:16:42 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:16:42 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:16:42 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:16:42 user nova-compute[75307]:       <nova:owner>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:user uuid="1395b52398a14f21933e00866ee52ad8">tempest-ServerActionsV293TestJSON-1262901442-project-member</nova:user>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:project uuid="f06c812f7eb14d6787f160b2c9e0c7f8">tempest-ServerActionsV293TestJSON-1262901442</nova:project>
Nov 13 23:16:42 user nova-compute[75307]:       </nova:owner>
Nov 13 23:16:42 user nova-compute[75307]:       <nova:ports>
Nov 13 23:16:42 user nova-compute[75307]:         <nova:port uuid="dd6f1e80-dce1-4984-9458-d1dd8cd0cab2">
Nov 13 23:16:42 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:16:42 user nova-compute[75307]:         </nova:port>
Nov 13 23:16:42 user nova-compute[75307]:       </nova:ports>
Nov 13 23:16:42 user nova-compute[75307]:     </nova:instance>
Nov 13 23:16:42 user nova-compute[75307]:   </metadata>
Nov 13 23:16:42 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:16:42 user nova-compute[75307]:     <system>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="serial">f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</entry>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="uuid">f700766b-4cb7-4eb9-a0b4-62e2c9c33a77</entry>
Nov 13 23:16:42 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:16:42 user nova-compute[75307]:     </system>
Nov 13 23:16:42 user nova-compute[75307]:   </sysinfo>
Nov 13 23:16:42 user nova-compute[75307]:   <os>
Nov 13 23:16:42 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:16:42 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:16:42 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:16:42 user nova-compute[75307]:   </os>
Nov 13 23:16:42 user nova-compute[75307]:   <features>
Nov 13 23:16:42 user nova-compute[75307]:     <acpi/>
Nov 13 23:16:42 user nova-compute[75307]:     <apic/>
Nov 13 23:16:42 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:16:42 user nova-compute[75307]:   </features>
Nov 13 23:16:42 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:16:42 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:16:42 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:16:42 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:16:42 user nova-compute[75307]:   </clock>
Nov 13 23:16:42 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:16:42 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:16:42 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:16:42 user nova-compute[75307]:   </cpu>
Nov 13 23:16:42 user nova-compute[75307]:   <devices>
Nov 13 23:16:42 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:16:42 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:42 user nova-compute[75307]:       <source dev="/dev/sdn"/>
Nov 13 23:16:42 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:16:42 user nova-compute[75307]:       <serial>bb0cf1e3-92ed-43bd-902d-617253af6522</serial>
Nov 13 23:16:42 user nova-compute[75307]:     </disk>
Nov 13 23:16:42 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:16:42 user nova-compute[75307]:       <mac address="fa:16:3e:73:43:d1"/>
Nov 13 23:16:42 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:16:42 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:16:42 user nova-compute[75307]:       <target dev="tapdd6f1e80-dc"/>
Nov 13 23:16:42 user nova-compute[75307]:     </interface>
Nov 13 23:16:42 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:16:42 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77/console.log" append="off"/>
Nov 13 23:16:42 user nova-compute[75307]:     </serial>
Nov 13 23:16:42 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:16:42 user nova-compute[75307]:     <video>
Nov 13 23:16:42 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:16:42 user nova-compute[75307]:     </video>
Nov 13 23:16:42 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:16:42 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:16:42 user nova-compute[75307]:     </rng>
Nov 13 23:16:42 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:16:42 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:16:42 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:16:42 user nova-compute[75307]:     </memballoon>
Nov 13 23:16:42 user nova-compute[75307]:   </devices>
Nov 13 23:16:42 user nova-compute[75307]: </domain>
Nov 13 23:16:42 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899693339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:16:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG os_vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '215f5ff7-41b8-569e-ba1e-7e4346cb897f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd6f1e80-dc, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd6f1e80-dc, col_values=(('qos', UUID('dd6840e6-bf77-400d-aed5-275e8158bbcd')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd6f1e80-dc, col_values=(('external_ids', {'iface-id': 'dd6f1e80-dce1-4984-9458-d1dd8cd0cab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:43:d1', 'vm-uuid': 'f700766b-4cb7-4eb9-a0b4-62e2c9c33a77'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:42 user nova-compute[75307]: INFO os_vif [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc')
Nov 13 23:16:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:42 user nova-compute[75307]: INFO nova.compute.manager [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Detaching volume c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] No VIF found with MAC fa:16:3e:73:43:d1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:16:43 user nova-compute[75307]: INFO nova.virt.block_device [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Attempting to driver detach volume c8d3ee99-43ff-4c8f-9096-8e0d525d1552 from mountpoint /dev/vdb
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Attempting to detach device vdb from instance e1e6da31-8158-4824-956b-c3f619dd06b4 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:43 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:43 user nova-compute[75307]:   <source dev="/dev/sdj"/>
Nov 13 23:16:43 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:43 user nova-compute[75307]:   <serial>c8d3ee99-43ff-4c8f-9096-8e0d525d1552</serial>
Nov 13 23:16:43 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:16:43 user nova-compute[75307]: </disk>
Nov 13 23:16:43 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Successfully detached device vdb from instance e1e6da31-8158-4824-956b-c3f619dd06b4 from the persistent domain config.
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e1e6da31-8158-4824-956b-c3f619dd06b4 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] detach device xml: <disk type="block" device="disk">
Nov 13 23:16:43 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:16:43 user nova-compute[75307]:   <source dev="/dev/sdj"/>
Nov 13 23:16:43 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:16:43 user nova-compute[75307]:   <serial>c8d3ee99-43ff-4c8f-9096-8e0d525d1552</serial>
Nov 13 23:16:43 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:16:43 user nova-compute[75307]: </disk>
Nov 13 23:16:43 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:44 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No waiting events found dispatching network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:44 user nova-compute[75307]: WARNING nova.compute.manager [req-4ca05df7-ace7-4dad-93c5-247adf7c6bad req-3dd5c41f-2f0f-4e3b-a81d-2b937e6a4a38 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 23:16:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-changed-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing instance network info cache due to event network-changed-30a66290-39b4-431b-8cf3-b315d3b30d95. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] Acquiring lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] Acquired lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Refreshing network info cache for port 30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updated VIF entry in instance network info cache for port 30a66290-39b4-431b-8cf3-b315d3b30d95. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-61fab3e9-c24c-4d42-a8eb-27ece536227a req-635df2e0-5c40-43ed-8864-9a206675b45c service nova] Releasing lock "refresh_cache-168a86c8-0c1f-460a-b8c5-d09474abd204" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:16:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance spawned successfully.
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.objects.instance [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75307) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] No waiting events found dispatching network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:46 user nova-compute[75307]: WARNING nova.compute.manager [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received unexpected event network-vif-plugged-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 for instance with vm_state active and task_state None.
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-changed-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing instance network info cache due to event network-changed-529a4d1e-d74f-4597-be93-4b8f78d5b83d. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Acquiring lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Acquired lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG nova.network.neutron [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Refreshing network info cache for port 529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:16:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-132aa086-a9c8-4297-9f69-f26dc30e36bc tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.076s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.network.neutron [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updated VIF entry in instance network info cache for port 529a4d1e-d74f-4597-be93-4b8f78d5b83d. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.network.neutron [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f241d2d9-b148-4966-8a28-9f58e2fce4ea req-fd9bf09d-43ad-426e-897c-4a58c073983a service nova] Releasing lock "refresh_cache-88f67d93-784c-4a3c-950a-f018df17dbf9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:47 user nova-compute[75307]: INFO nova.compute.manager [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Terminating instance
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-9d60e4e6-dbd8-414f-90ac-1a30539b1b25 req-31fb894f-ccb1-4865-923d-f0405e30fef3 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-776b8241-d302-44ff-a555-c3aed5b862ea for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-c289aec9-7f39-41e7-9741-96caacf27e71 req-00d13e16-0ae4-4f33-8125-1576fc7c88aa service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-3fae5474-9283-4712-88f6-15f7e002f729 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ea05ed6f-d9fa-4393-beb6-569f50defea6 is timed out.
Nov 13 23:16:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully detached device vdb from instance ea05ed6f-d9fa-4393-beb6-569f50defea6 from the live domain config.
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yIVuZczT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6586a0-eca1-437d-99d1-b590f323ac8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:48 user nova-compute[75307]: No targets found.
Nov 13 23:16:48 user nova-compute[75307]: iSNS:
Nov 13 23:16:48 user nova-compute[75307]: No targets found.
Nov 13 23:16:48 user nova-compute[75307]: STATIC:
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:48 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:48 user nova-compute[75307]: No targets found.
Nov 13 23:16:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:48 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:48 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[806336be-4e86-4581-a67a-a51d75df4716]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a1160b-f9a5-46aa-9f6c-a5b9397440cd]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3459ce50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba6cc3-f9ba-4b5e-a69e-aa1b1c35f519]: (4, ('path checker states:\nup                  13\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[104fa329-b792-43ef-b20f-1569e2d21f1a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ae02f2-a7b9-44bd-aea1-e86c4dab532e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.061s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b83926-a980-4eda-8338-b3d548921a30]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-30a66290-39b4-431b-8cf3-b315d3b30d95 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:48 user nova-compute[75307]: WARNING nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-30a66290-39b4-431b-8cf3-b315d3b30d95 for instance with vm_state active and task_state deleting.
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:48 user nova-compute[75307]: WARNING nova.compute.manager [req-50bc30cb-3fcd-40f5-b3d6-7ab4c666ac21 req-b7fd44ec-a2af-4efb-befb-6fdf4e0f9687 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb for instance with vm_state active and task_state deleting.
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f30955-6b0c-486a-9181-c301c8fc59a5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc6ce98-e93f-4f2c-94ab-1f032619c282]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260]
Nov 13 23:16:49 user nova-compute[75307]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:49 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f372524-699c-46fb-9ecd-a9b1adb60185 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.053s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[876f056b-73e3-4723-b85d-a15ff9551199]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] <== disconnect_volume: return (443ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Instance destroyed successfully.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lazy-loading 'resources' on Instance uuid 168a86c8-0c1f-460a-b8c5-d09474abd204 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: WARNING nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-776b8241-d302-44ff-a555-c3aed5b862ea for instance with vm_state active and task_state deleting.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: WARNING nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-bf414311-7c66-4120-bb8d-f3bf1a4edf6c for instance with vm_state active and task_state deleting.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: WARNING nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-29ba599d-1525-44d6-acb7-39e09bfdb2fc for instance with vm_state active and task_state deleting.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-unplugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-unplugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: WARNING nova.compute.manager [req-4dbc1cc4-9d6e-466d-ab93-39dbe3462f38 req-df701ab6-bb7a-4070-8893-966e721c4b4c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-76aef077-44a9-4e57-bc0a-dce4fe48a29a for instance with vm_state active and task_state deleting.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30a66290-39, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: INFO nova.compute.manager [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Terminating instance
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] Acquiring lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] No waiting events found dispatching network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:50 user nova-compute[75307]: WARNING nova.compute.manager [req-4093b4e3-aba2-4970-b306-fb17853fccb9 req-e408ddf3-32de-4d2f-8bb1-347bdea8ee9c service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received unexpected event network-vif-plugged-3fae5474-9283-4712-88f6-15f7e002f729 for instance with vm_state active and task_state deleting.
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ead3aa4-14a5-4efb-98b4-a4cd40347ad2) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:d6:ad,bridge_name='br-int',has_traffic_filtering=True,id=30a66290-39b4-431b-8cf3-b315d3b30d95,network=Network(d8cea792-da74-4d61-b965-e4747a3843c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30a66290-39')
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap776b8241-d3, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5a840c6-bd12-48e0-a08f-e01c5b7c8348) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'flavor' on Instance uuid ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-13df0632-3f38-4f32-8ea0-08fb49178870 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.553s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:9c:7b,bridge_name='br-int',has_traffic_filtering=True,id=776b8241-d302-44ff-a555-c3aed5b862ea,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap776b8241-d3')
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3fae5474-92, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7b3efa12-5732-468f-9f86-29f38a70e780) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:03,bridge_name='br-int',has_traffic_filtering=True,id=3fae5474-9283-4712-88f6-15f7e002f729,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3fae5474-92')
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf414311-7c, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-1a5c6140-605c-43d5-8c6d-1ecaae4a3a9c req-24bdfa06-aa0d-4182-926e-299268ede534 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72248b66-e353-4c6c-813e-bcfd17b925f6) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:14:78,bridge_name='br-int',has_traffic_filtering=True,id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf414311-7c')
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "address": "fa:16:3e:40:3e:42", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.72", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ba599d-15", "ovs_interfaceid": "29ba599d-1525-44d6-acb7-39e09bfdb2fc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ba599d-15, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3633150-9a8e-4481-89c2-897bd115bc08) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-297f6b9c-365b-4425-93f6-723289aa7f05 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-297f6b9c-365b-4425-93f6-723289aa7f05 for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-08662ca2-b0d2-49d8-9977-23e024ead7b2 for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-14561074-a474-4b12-9582-7089aa2182af req-a0156b37-8c6e-4a35-9039-61ca393f1580 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e265bbba-9ac8-4285-9ab2-96cd40534cfc for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Instance destroyed successfully.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lazy-loading 'resources' on Instance uuid 88f67d93-784c-4a3c-950a-f018df17dbf9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap529a4d1e-d7, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:3e:42,bridge_name='br-int',has_traffic_filtering=True,id=29ba599d-1525-44d6-acb7-39e09bfdb2fc,network=Network(a84266e1-a2ed-43a7-a514-56a173d1bce9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ba599d-15')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-529a4d1e-d74f-4597-be93-4b8f78d5b83d for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-e12a5c67-8e16-4165-b605-343c0a49f279 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-e12a5c67-8e16-4165-b605-343c0a49f279 for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-unplugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-unplugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING nova.compute.manager [req-a8bfb9e1-eeb0-4642-878e-8a78df376621 req-428d9186-4236-4fc7-9b41-ba08f652756e service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-66208d45-ab14-47f4-a5e9-9c8190d7d691 for instance with vm_state active and task_state deleting.
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f9b7d7e-01, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe56db6e-1fef-4c46-9085-86be93b30bd9) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a00142ed-987b-4dfd-b2f7-bfd8bc4a438c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:32:65:3b,bridge_name='br-int',has_traffic_filtering=True,id=529a4d1e-d74f-4597-be93-4b8f78d5b83d,network=Network(c274d175-1550-4b39-a0db-668bb2801d41),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529a4d1e-d7')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape12a5c67-8e, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:53:4f,bridge_name='br-int',has_traffic_filtering=True,id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f9b7d7e-01')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1737812577',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1737812577',id=10,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCKjqPNxPleeez/RLJzxhnGzUTGEaUqQcRLoqyte5csxft5EuxPif/WUwg3GJF15UuNutrqqI3UZ3HktsbWzCFdBLeYYqMBJ8eK3nL9vzjWIRi44xbT4Q/LhpzfrDafBjg==',key_name='tempest-keypair-2044701188',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='77bb6fa016ff4af0a50f482b42bc697c',ramdisk_id='',reservation_id='r-5dzn7rws',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-355361262',owner_user_name='tempest-TaggedBootDevicesTest-355361262-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a393b4b200da47758de47328ac1db5b2',uuid=168a86c8-0c1f-460a-b8c5-d09474abd204,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converting VIF {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap76aef077-44, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7a2a2e-4454-49d6-abb6-bf1bddae2ca4) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a30348e2-0c31-408a-8e23-9d29157e82ce) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:38:4e,bridge_name='br-int',has_traffic_filtering=True,id=e12a5c67-8e16-4165-b605-343c0a49f279,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape12a5c67-8e')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap297f6b9c-36, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:bc:ef,bridge_name='br-int',has_traffic_filtering=True,id=76aef077-44a9-4e57-bc0a-dce4fe48a29a,network=Network(8367f2a5-928a-4520-b7c0-9e33e2c375ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap76aef077-44')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wTMgtiNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:52 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26b0b00-aae0-40dd-9964-f45f4c3753d5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:52 user nova-compute[75307]: No targets found.
Nov 13 23:16:52 user nova-compute[75307]: iSNS:
Nov 13 23:16:52 user nova-compute[75307]: No targets found.
Nov 13 23:16:52 user nova-compute[75307]: STATIC:
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:52 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:52 user nova-compute[75307]: No targets found.
Nov 13 23:16:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:52 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:52 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92f3a5ef-6542-4cb6-af72-ac76b01edb11) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ff0b96-f3ae-4aec-a742-07e6d27ab0fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:de:29,bridge_name='br-int',has_traffic_filtering=True,id=297f6b9c-365b-4425-93f6-723289aa7f05,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap297f6b9c-36')
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "address": "fa:16:3e:6f:71:47", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08662ca2-b0", "ovs_interfaceid": "08662ca2-b0d2-49d8-9977-23e024ead7b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08662ca2-b0, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96830f-49a8-479f-89fd-b58cf7cdf1fe]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c1185e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cfb2cf-3992-4f5f-aad6-f41c26844f19]: (4, ('path checker states:\nup                  12\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d408f1-b05f-4336-8284-8f4f913f6b3e]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91ba29f-e6a1-4bbf-bda2-e778fea5539a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb3acb08-e59e-404a-a836-40ecd01c2419) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f88671-03e7-4149-ac49-4ae96d408d88]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:53 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:71:47,bridge_name='br-int',has_traffic_filtering=True,id=08662ca2-b0d2-49d8-9977-23e024ead7b2,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08662ca2-b0')
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape265bbba-9a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79b3d3-66e6-4288-aaa7-5a019ce8412f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e8854bb-5988-413b-9519-8d2315831d7b) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:70:42,bridge_name='br-int',has_traffic_filtering=True,id=e265bbba-9ac8-4285-9ab2-96cd40534cfc,network=Network(6fb443e5-9c62-4286-8994-02674052f9b1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape265bbba-9a')
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap66208d45-ab, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07f4f478-63b5-4fde-834e-42cce89751fe) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[864a4937-bf79-429c-8e35-c5207bf585ce]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260]
Nov 13 23:16:53 user nova-compute[75307]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:43:54,bridge_name='br-int',has_traffic_filtering=True,id=66208d45-ab14-47f4-a5e9-9c8190d7d691,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap66208d45-ab')
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-244937618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-244937618',id=11,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFJtc0HZNSWScse8CDqn0p/v3/kZlFhCumidaSr4TdALfmJ4bGINO1mxWA7hQCLKPKUVaxYFRi7FkJegHj/sSU8PGWcXXksK7ZsOi5Aqsi98jAHwrWPbAnwDcW+6ZqobpQ==',key_name='tempest-keypair-116545653',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d0d5bd749bf4842ad65455a62a38050',ramdisk_id='',reservation_id='r-308vo4ht',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1231581178',owner_user_name='tempest-TaggedBootDevicesTest_v242-1231581178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4fff7e1828fb40a7abf08b66561bf476',uuid=88f67d93-784c-4a3c-950a-f018df17dbf9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converting VIF {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96f15ea7-8a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51d74cc5-ff12-44c1-a50a-16792c2fd5b7) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb281af2-2436-400f-af9f-9ba3afff380a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[680c45e4-7dde-45a1-bf31-d3da68f7b110]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== disconnect_volume: return (380ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqigXVyE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:53 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: INFO os_vif [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:d5,bridge_name='br-int',has_traffic_filtering=True,id=96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0,network=Network(1554ea97-1211-44fd-b880-fb59badc7af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96f15ea7-8a')
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHQlOYWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:53 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb978bf-0cdf-48d6-be85-22a6a968e329]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: iSNS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: STATIC:
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:53 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad105a1-859b-4eca-a745-df63631b4cc3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef27b7aa-afd4-4cdf-a620-9e58a9363eb0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb345a3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d'): ({'sdg'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Removing single pathed devices sdg {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedc5837-03d4-499c-bde4-ee7a4d74c486]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5da63b6-fbc0-415e-9ea2-9163d1352907]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Flushing IO for device /dev/sdg {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8087378-711d-4cdf-971f-49efa70eebbc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcbf5f6-4968-483b-a5e4-ba6f18cb6d76]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c987cd8-5b18-47bb-aed4-93ef33be29ca]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] Acquiring lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] No waiting events found dispatching network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:53 user nova-compute[75307]: WARNING nova.compute.manager [req-2118faf6-725a-4dd8-b03f-d99accd64775 req-4bcc0af7-539a-4a46-88fb-f94b7edbe309 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received unexpected event network-vif-plugged-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 for instance with vm_state active and task_state deleting.
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a063615-8ebb-4599-b660-404109f98de6]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260]
Nov 13 23:16:53 user nova-compute[75307]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:15abcfec-0170-476d-8fde-0cabd553cd3d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd1a400-fe56-46ce-b4e4-3273732493c3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== disconnect_volume: return (349ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.341s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XbWlGcRA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:53 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[692605fe-4378-4ebf-8dc7-1e61fb7dbbf8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: iSNS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: STATIC:
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:53 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a15bf-3d39-4393-940e-cb5d0dff43ba]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc5f53b-8146-4304-aac9-43e6565e0ef2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c592290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d7c283-565d-474e-bb73-8b69c7443dd3]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1385b4-949b-445e-bdbc-afc17ae4c506]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30366a7-c5c9-4248-8a85-aa788c425845]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd021e37-4c54-47f4-b790-449c3cbe3bad]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc03eca-26df-4b80-9387-aa071ddbea7a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccf4f14-e7e6-4c31-b60c-f67168356188]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260]
Nov 13 23:16:53 user nova-compute[75307]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ce39eef-0f09-49bb-b210-b6f80559a55b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[01926316-0b1f-4e1c-971b-651864926e32]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== disconnect_volume: return (677ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.334s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eNVprhDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:53 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ee384f-a5f8-4061-93c5-4acc98f3ec01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: iSNS:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]: STATIC:
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:53 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:53 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:53 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:53 user nova-compute[75307]: No targets found.
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:53 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:53 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fcbaa4-2c83-4bc3-988e-f9a40de7441e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6052616b-299e-401a-ba3e-be1f3066bfb0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 (non-flash)
Nov 13 23:16:53 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c592290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732'): ({'sdi'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Removing single pathed devices sdi {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6bc66e-f141-44c8-bbb2-a98708c58223]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad5df03-75ec-4ee3-86f5-5621a00adae7]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Flushing IO for device /dev/sdi {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c01219-7d6e-44cf-9cb5-9f5f1ba5afdf]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0effaf-6a27-4f7d-b6b0-7bf66a240629]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] SCSI volumes sdi have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f012b4ec-b2ab-4fcd-9524-1e39f0bbf8db]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c83132-6227-4bf9-aec2-205b21cadb42]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260]
Nov 13 23:16:54 user nova-compute[75307]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c0d7550-28e9-44c8-ad8e-9d7713a21732 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf515eb-a652-4cd2-a2ef-f622f4eb5ec0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] <== disconnect_volume: return (650ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Deleting instance files /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204_del
Nov 13 23:16:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Deletion of /opt/stack/data/nova/instances/168a86c8-0c1f-460a-b8c5-d09474abd204_del complete
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4df1b2-d907-4233-bc86-1fd972728fe0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: iSNS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: STATIC:
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:54 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f05466b-cacd-4974-9099-78e8ac43b268]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: INFO nova.compute.manager [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Took 6.81 seconds to destroy the instance on the hypervisor.
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ac5ca7-45b3-4857-bfcb-7950db0d1910]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3433be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e'): ({'sdf'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Removing single pathed devices sdf {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b956a4-96f5-40bb-8cda-c06da4966c65]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cfa616-621a-40eb-9520-2dcf53158b3f]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Flushing IO for device /dev/sdf {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[96220574-ffb2-4458-a850-a834014bd502]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab299705-9654-482d-84a1-cf32c41dcb25]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca82744-4aed-4780-bc0e-60c01f80430f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa is timed out.
Nov 13 23:16:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully detached device vdb from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the live domain config.
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YFBCOLzK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e5ff10-a9bc-42a9-9a19-1c289c79827e]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260]
Nov 13 23:16:54 user nova-compute[75307]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52d7e108-39a0-47f1-a217-3b5eb36ecc4e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81442e38-0645-4486-b34f-11960eea1981]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== disconnect_volume: return (665ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.090s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MFdQtsCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a4536f-86b8-4707-ada2-c3a265ec4a5f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: iSNS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: STATIC:
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:54 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd76d49-fa8f-4f45-9200-576fd4229013]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6627dd41-6eb8-42ff-bf4b-2b5ba85ab58c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb345a3eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6'): ({'sdl'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Removing single pathed devices sdl {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f862faf3-7d3a-46e4-a097-e32754e3d674]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[558fa92d-dbca-4f82-a03d-01a35cbe9d98]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Flushing IO for device /dev/sdl {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c14cf-3b21-4e20-95f5-7fb1e421b614]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a34337-2a05-4296-81dc-5588ab7a0267]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Checking to see if SCSI volumes sdl have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] SCSI volumes sdl have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03aa406-ac52-4975-b48e-df25e31f628d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4baec4bb-40a5-47be-bab2-ebc5b8e578a4]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260]
Nov 13 23:16:54 user nova-compute[75307]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1accccb-5437-4867-9260-5965cb4a1aa6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95f3c4-2e25-48eb-96ea-8def5aebcd76]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] <== disconnect_volume: return (402ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.314s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdca1f5-1359-4a65-8c11-27f6469a7491]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: iSNS:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]: STATIC:
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:54 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:54 user nova-compute[75307]: No targets found.
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:54 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:54 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa34bc9-1bb5-4b01-b2df-bc93a4f746e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[267eac27-0f14-42bb-a95a-c0f3412b42b4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 (non-flash)
Nov 13 23:16:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3cfc0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3'): ({'sdh'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Removing single pathed devices sdh {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbd88f0-3e02-4619-90c3-3df1730846a2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3666fec-79a2-493e-a72c-f102bcf5b037]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Flushing IO for device /dev/sdh {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c3d830-0673-41c2-91c3-ee6840010da2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be508fd8-cb88-4318-95fb-7363b22e0655]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] SCSI volumes sdh have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec07907-3974-4ef4-abe6-8d713d06f826]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d321bcff-3e7c-405c-9d7e-47a0aabe85bd]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260]
Nov 13 23:16:55 user nova-compute[75307]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06ee24dd-a607-4abd-ac50-f9846a3d78f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d5cef9f-9e07-4dfe-b478-0c0071cba416]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] <== disconnect_volume: return (674ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Deleting instance files /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9_del
Nov 13 23:16:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Deletion of /opt/stack/data/nova/instances/88f67d93-784c-4a3c-950a-f018df17dbf9_del complete
Nov 13 23:16:55 user nova-compute[75307]: INFO nova.compute.manager [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Took 5.45 seconds to destroy the instance on the hypervisor.
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:55 user nova-compute[75307]: INFO nova.compute.manager [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Terminating instance
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0f67a3a3-418a-4287-b639-8b285caaf4ec is timed out.
Nov 13 23:16:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Successfully detached device sdc from instance 0f67a3a3-418a-4287-b639-8b285caaf4ec from the live domain config.
Nov 13 23:16:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXkqSWEZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdm'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b40d2c4-1815-45e6-887b-c3c9296c34c8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.055s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced2389-9f07-4958-8afb-ce27dbd4c24f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:55 user nova-compute[75307]: No targets found.
Nov 13 23:16:55 user nova-compute[75307]: iSNS:
Nov 13 23:16:55 user nova-compute[75307]: No targets found.
Nov 13 23:16:55 user nova-compute[75307]: STATIC:
Nov 13 23:16:55 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:55 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:55 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:55 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:55 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:55 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:55 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:55 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:55 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:55 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:55 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:55 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:55 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b
Nov 13 23:16:55 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:55 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:55 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:55 user nova-compute[75307]: No targets found.
Nov 13 23:16:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:55 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:55 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66884713-1c8c-4da9-b836-788a5cd82678]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28bd68f-5130-4e33-a0aa-f97aeb3010fb]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c2cfbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b'): ({'sdm'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Removing single pathed devices sdm {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63a23dd-9819-4766-be97-2f3535fc6e59]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdm {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdm" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebdb870-f396-4332-b1f0-78f0537c7f60]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Flushing IO for device /dev/sdm {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdm {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdm" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a0573d-a54f-4612-92e1-94b54dace918]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdm/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-5be31f7e-945d-41fa-85f4-17bdcabdf53e req-7ae2ff13-5d53-490f-97fc-d363b57f2004 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-deleted-29ba599d-1525-44d6-acb7-39e09bfdb2fc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:56 user nova-compute[75307]: INFO nova.compute.manager [req-5be31f7e-945d-41fa-85f4-17bdcabdf53e req-7ae2ff13-5d53-490f-97fc-d363b57f2004 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Neutron deleted interface 29ba599d-1525-44d6-acb7-39e09bfdb2fc; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-5be31f7e-945d-41fa-85f4-17bdcabdf53e req-7ae2ff13-5d53-490f-97fc-d363b57f2004 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "address": "fa:16:3e:2a:14:78", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf414311-7c", "ovs_interfaceid": "bf414311-7c66-4120-bb8d-f3bf1a4edf6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdm/device/delete" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3a4f9a-1146-4e05-a6f5-d863e9274c9b]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Checking to see if SCSI volumes sdm have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] SCSI volumes sdm have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86a1856-7f6b-4dcb-825d-7326bdf26eaf]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-5be31f7e-945d-41fa-85f4-17bdcabdf53e req-7ae2ff13-5d53-490f-97fc-d363b57f2004 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Detach interface failed, port_id=29ba599d-1525-44d6-acb7-39e09bfdb2fc, reason: Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-unplugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] No waiting events found dispatching network-vif-unplugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8e07f64-d074-48a9-8097-1adcc3e1d92b req-f36571be-e0d4-4b82-b803-6e5a596f4cc1 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-unplugged-5454f7e7-63a9-4562-9303-9057b4241b3d for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb884f5c-389e-4afc-a68f-9bffd479e58e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260]
Nov 13 23:16:56 user nova-compute[75307]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:53ab6ef8-0642-42da-b000-cab42ac0100b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[193615b4-be89-42bb-bd58-2d607c73724f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] <== disconnect_volume: return (401ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Instance destroyed successfully.
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.objects.instance [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid 9bae8cbf-0579-46ec-b459-fa47c43efe8e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:15:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1829958291',display_name='tempest-TestVolumeBootPattern-server-1829958291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1829958291',id=12,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-azkg168o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:15:25Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=9bae8cbf-0579-46ec-b459-fa47c43efe8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "5454f7e7-63a9-4562-9303-9057b4241b3d", "address": "fa:16:3e:a4:3d:00", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5454f7e7-63", "ovs_interfaceid": "5454f7e7-63a9-4562-9303-9057b4241b3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_vif [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5454f7e7-63, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c34a647b-0e96-4604-aabb-411e8c167cc5) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:56 user nova-compute[75307]: INFO os_vif [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:3d:00,bridge_name='br-int',has_traffic_filtering=True,id=5454f7e7-63a9-4562-9303-9057b4241b3d,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5454f7e7-63')
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iqvKgXxt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:16:56 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.034s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafbcb43-5a8c-49ae-916d-41b7d7fe3864]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:16:56 user nova-compute[75307]: No targets found.
Nov 13 23:16:56 user nova-compute[75307]: iSNS:
Nov 13 23:16:56 user nova-compute[75307]: No targets found.
Nov 13 23:16:56 user nova-compute[75307]: STATIC:
Nov 13 23:16:56 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:16:56 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:56 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:56 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:16:56 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:56 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:56 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074
Nov 13 23:16:56 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:56 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:56 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:16:56 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:16:56 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:16:56 user nova-compute[75307]: FIRMWARE:
Nov 13 23:16:56 user nova-compute[75307]: No targets found.
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:16:56 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:16:56 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0818d901-7e35-47d8-9354-7df6a19b325d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc01f48b-cdda-44f9-8d93-675a5782b7a6]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 (non-flash)
Nov 13 23:16:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c2cf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-bb849627-f5fa-43f2-b070-1a5ec11a4d08" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-bb849627-f5fa-43f2-b070-1a5ec11a4d08" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.objects.instance [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ece895-74d2-41d6-bc83-9107d3356f8f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f49a1e7-67e3-4ef2-af5e-0d7ed3de1593]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Attempting to detach device tapbb849627-f5 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] detach device xml: <interface type="ethernet">
Nov 13 23:16:56 user nova-compute[75307]:   <mac address="fa:16:3e:d5:e1:e3"/>
Nov 13 23:16:56 user nova-compute[75307]:   <model type="virtio"/>
Nov 13 23:16:56 user nova-compute[75307]:   <mtu size="1442"/>
Nov 13 23:16:56 user nova-compute[75307]:   <target dev="tapbb849627-f5"/>
Nov 13 23:16:56 user nova-compute[75307]: </interface>
Nov 13 23:16:56 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8181e79-3348-4673-901b-5ae99ad1610a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 13 23:16:56 user nova-compute[75307]:   <name>instance-00000007</name>
Nov 13 23:16:56 user nova-compute[75307]:   <uuid>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</uuid>
Nov 13 23:16:56 user nova-compute[75307]:   <metadata>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:16:56 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:16:24</nova:creationTime>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:16:56 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:16:56 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:owner>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:16:56 user nova-compute[75307]:   </nova:owner>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:16:56 user nova-compute[75307]:   <nova:ports>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:16:56 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:16:56 user nova-compute[75307]:     </nova:port>
Nov 13 23:16:56 user nova-compute[75307]:     <nova:port uuid="bb849627-f5fa-43f2-b070-1a5ec11a4d08">
Nov 13 23:16:56 user nova-compute[75307]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 13 23:16:56 user nova-compute[75307]:     </nova:port>
Nov 13 23:16:56 user nova-compute[75307]:   </nova:ports>
Nov 13 23:16:56 user nova-compute[75307]: </nova:instance>
Nov 13 23:16:56 user nova-compute[75307]:   </metadata>
Nov 13 23:16:56 user nova-compute[75307]:   <memory unit='KiB'>524288</memory>
Nov 13 23:16:56 user nova-compute[75307]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 23:16:56 user nova-compute[75307]:   <vcpu placement='static'>1</vcpu>
Nov 13 23:16:56 user nova-compute[75307]:   <resource>
Nov 13 23:16:56 user nova-compute[75307]:     <partition>/machine</partition>
Nov 13 23:16:56 user nova-compute[75307]:   </resource>
Nov 13 23:16:56 user nova-compute[75307]:   <sysinfo type='smbios'>
Nov 13 23:16:56 user nova-compute[75307]:     <system>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='version'>0.0.0</entry>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='serial'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='uuid'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:16:56 user nova-compute[75307]:       <entry name='family'>Virtual Machine</entry>
Nov 13 23:16:56 user nova-compute[75307]:     </system>
Nov 13 23:16:56 user nova-compute[75307]:   </sysinfo>
Nov 13 23:16:56 user nova-compute[75307]:   <os>
Nov 13 23:16:56 user nova-compute[75307]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 23:16:56 user nova-compute[75307]:     <boot dev='hd'/>
Nov 13 23:16:56 user nova-compute[75307]:     <smbios mode='sysinfo'/>
Nov 13 23:16:56 user nova-compute[75307]:   </os>
Nov 13 23:16:56 user nova-compute[75307]:   <features>
Nov 13 23:16:56 user nova-compute[75307]:     <acpi/>
Nov 13 23:16:56 user nova-compute[75307]:     <apic/>
Nov 13 23:16:56 user nova-compute[75307]:     <vmcoreinfo state='on'/>
Nov 13 23:16:56 user nova-compute[75307]:   </features>
Nov 13 23:16:56 user nova-compute[75307]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 23:16:56 user nova-compute[75307]:     <model fallback='forbid'>Nehalem</model>
Nov 13 23:16:56 user nova-compute[75307]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 23:16:56 user nova-compute[75307]:     <feature policy='require' name='vme'/>
Nov 13 23:16:56 user nova-compute[75307]:     <feature policy='require' name='x2apic'/>
Nov 13 23:16:56 user nova-compute[75307]:     <feature policy='require' name='hypervisor'/>
Nov 13 23:16:56 user nova-compute[75307]:   </cpu>
Nov 13 23:16:56 user nova-compute[75307]:   <clock offset='utc'>
Nov 13 23:16:56 user nova-compute[75307]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 23:16:56 user nova-compute[75307]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 23:16:56 user nova-compute[75307]:     <timer name='hpet' present='no'/>
Nov 13 23:16:56 user nova-compute[75307]:   </clock>
Nov 13 23:16:56 user nova-compute[75307]:   <on_poweroff>destroy</on_poweroff>
Nov 13 23:16:56 user nova-compute[75307]:   <on_reboot>restart</on_reboot>
Nov 13 23:16:56 user nova-compute[75307]:   <on_crash>destroy</on_crash>
Nov 13 23:16:56 user nova-compute[75307]:   <devices>
Nov 13 23:16:56 user nova-compute[75307]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 23:16:56 user nova-compute[75307]:     <disk type='file' device='disk'>
Nov 13 23:16:56 user nova-compute[75307]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 23:16:56 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk' index='2'/>
Nov 13 23:16:56 user nova-compute[75307]:       <backingStore type='file' index='3'>
Nov 13 23:16:56 user nova-compute[75307]:         <format type='raw'/>
Nov 13 23:16:56 user nova-compute[75307]:         <source file='/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc'/>
Nov 13 23:16:56 user nova-compute[75307]:         <backingStore/>
Nov 13 23:16:56 user nova-compute[75307]:       </backingStore>
Nov 13 23:16:56 user nova-compute[75307]:       <target dev='vda' bus='virtio'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='virtio-disk0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </disk>
Nov 13 23:16:56 user nova-compute[75307]:     <disk type='file' device='cdrom'>
Nov 13 23:16:56 user nova-compute[75307]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 23:16:56 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config' index='1'/>
Nov 13 23:16:56 user nova-compute[75307]:       <backingStore/>
Nov 13 23:16:56 user nova-compute[75307]:       <target dev='hda' bus='ide'/>
Nov 13 23:16:56 user nova-compute[75307]:       <readonly/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='ide0-0-0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </disk>
Nov 13 23:16:56 user nova-compute[75307]:     <controller type='usb' index='0' model='none'>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='usb'/>
Nov 13 23:16:56 user nova-compute[75307]:     </controller>
Nov 13 23:16:56 user nova-compute[75307]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='pci.0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </controller>
Nov 13 23:16:56 user nova-compute[75307]:     <controller type='ide' index='0'>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='ide'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 23:16:56 user nova-compute[75307]:     </controller>
Nov 13 23:16:56 user nova-compute[75307]:     <interface type='ethernet'>
Nov 13 23:16:56 user nova-compute[75307]:       <mac address='fa:16:3e:8a:94:82'/>
Nov 13 23:16:56 user nova-compute[75307]:       <target dev='tapfb7cdb1d-f0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <model type='virtio'/>
Nov 13 23:16:56 user nova-compute[75307]:       <mtu size='1442'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='net0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </interface>
Nov 13 23:16:56 user nova-compute[75307]:     <interface type='ethernet'>
Nov 13 23:16:56 user nova-compute[75307]:       <mac address='fa:16:3e:d5:e1:e3'/>
Nov 13 23:16:56 user nova-compute[75307]:       <target dev='tapbb849627-f5'/>
Nov 13 23:16:56 user nova-compute[75307]:       <model type='virtio'/>
Nov 13 23:16:56 user nova-compute[75307]:       <mtu size='1442'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='net1'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </interface>
Nov 13 23:16:56 user nova-compute[75307]:     <serial type='pty'>
Nov 13 23:16:56 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:16:56 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:16:56 user nova-compute[75307]:       <target type='isa-serial' port='0'>
Nov 13 23:16:56 user nova-compute[75307]:         <model name='isa-serial'/>
Nov 13 23:16:56 user nova-compute[75307]:       </target>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </serial>
Nov 13 23:16:56 user nova-compute[75307]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 23:16:56 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:16:56 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:16:56 user nova-compute[75307]:       <target type='serial' port='0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </console>
Nov 13 23:16:56 user nova-compute[75307]:     <input type='mouse' bus='ps2'>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='input0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </input>
Nov 13 23:16:56 user nova-compute[75307]:     <input type='keyboard' bus='ps2'>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='input1'/>
Nov 13 23:16:56 user nova-compute[75307]:     </input>
Nov 13 23:16:56 user nova-compute[75307]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 23:16:56 user nova-compute[75307]:       <listen type='address' address='0.0.0.0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </graphics>
Nov 13 23:16:56 user nova-compute[75307]:     <audio id='1' type='none'/>
Nov 13 23:16:56 user nova-compute[75307]:     <video>
Nov 13 23:16:56 user nova-compute[75307]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='video0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </video>
Nov 13 23:16:56 user nova-compute[75307]:     <memballoon model='virtio'>
Nov 13 23:16:56 user nova-compute[75307]:       <stats period='10'/>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='balloon0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </memballoon>
Nov 13 23:16:56 user nova-compute[75307]:     <rng model='virtio'>
Nov 13 23:16:56 user nova-compute[75307]:       <backend model='random'>/dev/urandom</backend>
Nov 13 23:16:56 user nova-compute[75307]:       <alias name='rng0'/>
Nov 13 23:16:56 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 23:16:56 user nova-compute[75307]:     </rng>
Nov 13 23:16:56 user nova-compute[75307]:   </devices>
Nov 13 23:16:56 user nova-compute[75307]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 23:16:56 user nova-compute[75307]:     <label>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</label>
Nov 13 23:16:56 user nova-compute[75307]:     <imagelabel>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</imagelabel>
Nov 13 23:16:56 user nova-compute[75307]:   </seclabel>
Nov 13 23:16:56 user nova-compute[75307]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 23:16:56 user nova-compute[75307]:     <label>+64055:+108</label>
Nov 13 23:16:56 user nova-compute[75307]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 23:16:56 user nova-compute[75307]:   </seclabel>
Nov 13 23:16:56 user nova-compute[75307]: </domain>
Nov 13 23:16:56 user nova-compute[75307]:  {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 23:16:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully detached device tapbb849627-f5 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the persistent domain config.
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] (1/8): Attempting to detach device tapbb849627-f5 with device alias net1 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] detach device xml: <interface type="ethernet">
Nov 13 23:16:56 user nova-compute[75307]:   <mac address="fa:16:3e:d5:e1:e3"/>
Nov 13 23:16:56 user nova-compute[75307]:   <model type="virtio"/>
Nov 13 23:16:56 user nova-compute[75307]:   <mtu size="1442"/>
Nov 13 23:16:56 user nova-compute[75307]:   <target dev="tapbb849627-f5"/>
Nov 13 23:16:56 user nova-compute[75307]: </interface>
Nov 13 23:16:56 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c8a793-1723-4e26-809c-c3f4657e927b]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5c0df92d-af9af35b23270b6c', '/dev/disk/by-id/scsi-26166396166333562', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5c0df92d') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8d803b-03ee-4979-9237-062425080ec3]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[622ed2e4-6260-4b4a-aef2-b40f527c210a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad7726e-cd7c-4a99-a606-260d56c14b82]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260]
Nov 13 23:16:57 user nova-compute[75307]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074, portal: 172.16.0.220,3260] successful.
Nov 13 23:16:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2151b7e9-0651-4480-aff7-67c93be5e074 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[884f0610-f455-4081-8760-9e71db8aee37]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (449ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:16:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Deleting instance files /opt/stack/data/nova/instances/9bae8cbf-0579-46ec-b459-fa47c43efe8e_del
Nov 13 23:16:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Deletion of /opt/stack/data/nova/instances/9bae8cbf-0579-46ec-b459-fa47c43efe8e_del complete
Nov 13 23:16:57 user nova-compute[75307]: INFO nova.compute.manager [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Start waiting for the detach event from libvirt for device tapbb849627-f5 with device alias net1 for instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lazy-loading 'flavor' on Instance uuid 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9741da1-ea26-406d-b5b0-e59bf33040c7 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.068s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Terminating instance
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-deleted-bf414311-7c66-4120-bb8d-f3bf1a4edf6c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Neutron deleted interface bf414311-7c66-4120-bb8d-f3bf1a4edf6c; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "address": "fa:16:3e:60:53:4f", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f9b7d7e-01", "ovs_interfaceid": "2f9b7d7e-0154-42b0-b867-3dbb6cc0facb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Detach interface failed, port_id=bf414311-7c66-4120-bb8d-f3bf1a4edf6c, reason: Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-deleted-2f9b7d7e-0154-42b0-b867-3dbb6cc0facb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Neutron deleted interface 2f9b7d7e-0154-42b0-b867-3dbb6cc0facb; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "30a66290-39b4-431b-8cf3-b315d3b30d95", "address": "fa:16:3e:b2:d6:ad", "network": {"id": "d8cea792-da74-4d61-b965-e4747a3843c2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-945128963-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30a66290-39", "ovs_interfaceid": "30a66290-39b4-431b-8cf3-b315d3b30d95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Detach interface failed, port_id=2f9b7d7e-0154-42b0-b867-3dbb6cc0facb, reason: Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-deleted-30a66290-39b4-431b-8cf3-b315d3b30d95 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Neutron deleted interface 30a66290-39b4-431b-8cf3-b315d3b30d95; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [{"id": "776b8241-d302-44ff-a555-c3aed5b862ea", "address": "fa:16:3e:e4:9c:7b", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.75", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap776b8241-d3", "ovs_interfaceid": "776b8241-d302-44ff-a555-c3aed5b862ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3fae5474-9283-4712-88f6-15f7e002f729", "address": "fa:16:3e:d6:c0:03", "network": {"id": "a84266e1-a2ed-43a7-a514-56a173d1bce9", "bridge": "br-int", "label": "tempest-device-tagging-net1-1036574645", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3fae5474-92", "ovs_interfaceid": "3fae5474-9283-4712-88f6-15f7e002f729", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "address": "fa:16:3e:e7:bc:ef", "network": {"id": "8367f2a5-928a-4520-b7c0-9e33e2c375ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-1897984945", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "77bb6fa016ff4af0a50f482b42bc697c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap76aef077-44", "ovs_interfaceid": "76aef077-44a9-4e57-bc0a-dce4fe48a29a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Took 1.18 seconds to deallocate network for instance.
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ffcd70f-9811-41c9-8209-17c72552c15c req-a97cfb8f-d187-4cd9-97d9-8b9772b3ea50 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Detach interface failed, port_id=30a66290-39b4-431b-8cf3-b315d3b30d95, reason: Instance 168a86c8-0c1f-460a-b8c5-d09474abd204 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Acquiring lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] No waiting events found dispatching network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:58 user nova-compute[75307]: WARNING nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received unexpected event network-vif-plugged-5454f7e7-63a9-4562-9303-9057b4241b3d for instance with vm_state active and task_state deleting.
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-unplugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-unplugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:58 user nova-compute[75307]: WARNING nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-unplugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 for instance with vm_state active and task_state None.
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:16:58 user nova-compute[75307]: WARNING nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-bb849627-f5fa-43f2-b070-1a5ec11a4d08 for instance with vm_state active and task_state None.
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-deleted-08662ca2-b0d2-49d8-9977-23e024ead7b2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Neutron deleted interface 08662ca2-b0d2-49d8-9977-23e024ead7b2; detaching it from the instance and deleting it from the info cache
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "address": "fa:16:3e:bf:70:42", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape265bbba-9a", "ovs_interfaceid": "e265bbba-9ac8-4285-9ab2-96cd40534cfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-191f2d2b-11ad-40d9-89d9-dd866eae440a req-50c49750-abee-4880-9dea-f35373664419 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Detach interface failed, port_id=08662ca2-b0d2-49d8-9977-23e024ead7b2, reason: Instance 88f67d93-784c-4a3c-950a-f018df17dbf9 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Took 4.55 seconds to deallocate network for instance.
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Instance destroyed successfully.
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lazy-loading 'resources' on Instance uuid 0f67a3a3-418a-4287-b639-8b285caaf4ec {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-659387937',display_name='tempest-AttachSCSIVolumeTestJSON-server-659387937',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-659387937',id=8,image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8tSEnT716c/sdEIR58zOwBiNyZ3Wu+FxeBfLEsOK/Ev0Yx+sdV1c6E1HBWjnQA+RGxwodGyS/8LxRqCSL9VvdL2vmVHIr5aKSmw7869t7ssL094GxtLHwN5iJ6wW29Gg==',key_name='tempest-keypair-301741751',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d10327c6a1ac43608e69263beb3417c2',ramdisk_id='',reservation_id='r-xwzi8vpb',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b3db46b7-6a01-4754-b9c1-df6d1988ef05',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1302229424',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1302229424-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3fde426ad9b54386a28de0134432dd2a',uuid=0f67a3a3-418a-4287-b639-8b285caaf4ec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converting VIF {"id": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "address": "fa:16:3e:c6:ff:eb", "network": {"id": "ca2f098a-102a-4a8f-b843-fe62af54dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2132879801-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d10327c6a1ac43608e69263beb3417c2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0afdfdfa-53", "ovs_interfaceid": "0afdfdfa-53d3-46a5-90ad-d65ec1547664", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG os_vif [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0afdfdfa-53, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fb603688-b114-48d3-a179-e9abaa6f3b23) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:16:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:16:58 user nova-compute[75307]: INFO os_vif [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c6:ff:eb,bridge_name='br-int',has_traffic_filtering=True,id=0afdfdfa-53d3-46a5-90ad-d65ec1547664,network=Network(ca2f098a-102a-4a8f-b843-fe62af54dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0afdfdfa-53')
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Deleting instance files /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec_del
Nov 13 23:16:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Deletion of /opt/stack/data/nova/instances/0f67a3a3-418a-4287-b639-8b285caaf4ec_del complete
Nov 13 23:16:59 user nova-compute[75307]: INFO nova.compute.manager [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:16:59 user nova-compute[75307]: INFO nova.compute.manager [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Took 0.82 seconds to detach 1 volumes for instance.
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Deleting volume: 2151b7e9-0651-4480-aff7-67c93be5e074 {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:16:59 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance 9bae8cbf-0579-46ec-b459-fa47c43efe8e
Nov 13 23:16:59 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Took 0.74 seconds to deallocate network for instance.
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:16:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-831c8b9a-e258-46bc-a1c2-c14f100c768a tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "9bae8cbf-0579-46ec-b459-fa47c43efe8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.173s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.328s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:00 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Deleted allocations for instance 0f67a3a3-418a-4287-b639-8b285caaf4ec
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 9bae8cbf-0579-46ec-b459-fa47c43efe8e] Received event network-vif-deleted-5454f7e7-63a9-4562-9303-9057b4241b3d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-vif-unplugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] No waiting events found dispatching network-vif-unplugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:00 user nova-compute[75307]: WARNING nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received unexpected event network-vif-unplugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 for instance with vm_state deleted and task_state None.
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Received event network-vif-deleted-76aef077-44a9-4e57-bc0a-dce4fe48a29a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Acquiring lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] No waiting events found dispatching network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:00 user nova-compute[75307]: WARNING nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received unexpected event network-vif-plugged-0afdfdfa-53d3-46a5-90ad-d65ec1547664 for instance with vm_state deleted and task_state None.
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-753d709b-155c-4cf0-9371-da51228e073c req-ed47b43a-b1d9-4359-8f92-c946f008a242 service nova] [instance: 0f67a3a3-418a-4287-b639-8b285caaf4ec] Received event network-vif-deleted-0afdfdfa-53d3-46a5-90ad-d65ec1547664 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ae9b931f-27ec-404d-a257-efd17ae80e65 tempest-AttachSCSIVolumeTestJSON-1302229424 tempest-AttachSCSIVolumeTestJSON-1302229424-project-member] Lock "0f67a3a3-418a-4287-b639-8b285caaf4ec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.233s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-deleted-e265bbba-9ac8-4285-9ab2-96cd40534cfc {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: INFO nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Neutron deleted interface e265bbba-9ac8-4285-9ab2-96cd40534cfc; detaching it from the instance and deleting it from the info cache
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "address": "fa:16:3e:02:43:54", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap66208d45-ab", "ovs_interfaceid": "66208d45-ab14-47f4-a5e9-9c8190d7d691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Detach interface failed, port_id=e265bbba-9ac8-4285-9ab2-96cd40534cfc, reason: Instance 88f67d93-784c-4a3c-950a-f018df17dbf9 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-deleted-66208d45-ab14-47f4-a5e9-9c8190d7d691 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:00 user nova-compute[75307]: INFO nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Neutron deleted interface 66208d45-ab14-47f4-a5e9-9c8190d7d691; detaching it from the instance and deleting it from the info cache
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [{"id": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "address": "fa:16:3e:32:65:3b", "network": {"id": "c274d175-1550-4b39-a0db-668bb2801d41", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-902912903-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529a4d1e-d7", "ovs_interfaceid": "529a4d1e-d74f-4597-be93-4b8f78d5b83d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e12a5c67-8e16-4165-b605-343c0a49f279", "address": "fa:16:3e:95:38:4e", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.18", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape12a5c67-8e", "ovs_interfaceid": "e12a5c67-8e16-4165-b605-343c0a49f279", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "297f6b9c-365b-4425-93f6-723289aa7f05", "address": "fa:16:3e:cb:de:29", "network": {"id": "6fb443e5-9c62-4286-8994-02674052f9b1", "bridge": "br-int", "label": "tempest-device-tagging-net1-392988615", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.183", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap297f6b9c-36", "ovs_interfaceid": "297f6b9c-365b-4425-93f6-723289aa7f05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "address": "fa:16:3e:ee:89:d5", "network": {"id": "1554ea97-1211-44fd-b880-fb59badc7af7", "bridge": "br-int", "label": "tempest-device-tagging-net2-409423076", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "7d0d5bd749bf4842ad65455a62a38050", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96f15ea7-8a", "ovs_interfaceid": "96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-c180da8e-93d7-48c8-b0c0-26971436afc0 req-6f1b3aaf-a5d4-4a4f-9c71-d404ce1b97b1 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Detach interface failed, port_id=66208d45-ab14-47f4-a5e9-9c8190d7d691, reason: Instance 88f67d93-784c-4a3c-950a-f018df17dbf9 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:01 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Took 5.66 seconds to deallocate network for instance.
Nov 13 23:17:01 user nova-compute[75307]: INFO nova.compute.manager [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] [instance: 168a86c8-0c1f-460a-b8c5-d09474abd204] Took 2.79 seconds to detach 3 volumes for instance.
Nov 13 23:17:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:02 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Deleted allocations for instance 168a86c8-0c1f-460a-b8c5-d09474abd204
Nov 13 23:17:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24f9042b-e764-44ad-960f-71f1c83b4cd8 tempest-TaggedBootDevicesTest-355361262 tempest-TaggedBootDevicesTest-355361262-project-member] Lock "168a86c8-0c1f-460a-b8c5-d09474abd204" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.645s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-224aee23-1bb4-4302-a068-0ea50e7263d2 req-6d80893d-14d4-4e90-a017-5d58b466f532 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-deleted-529a4d1e-d74f-4597-be93-4b8f78d5b83d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-224aee23-1bb4-4302-a068-0ea50e7263d2 req-6d80893d-14d4-4e90-a017-5d58b466f532 service nova] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Received event network-vif-deleted-96f15ea7-8ad9-4f9d-b74c-9c95ef21c6d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e1e6da31-8158-4824-956b-c3f619dd06b4 is timed out.
Nov 13 23:17:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Successfully detached device vdb from instance e1e6da31-8158-4824-956b-c3f619dd06b4 from the live domain config.
Nov 13 23:17:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ozpEthAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:17:03 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c587efe1-feda-4456-97f7-5fe41155486c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:17:03 user nova-compute[75307]: No targets found.
Nov 13 23:17:03 user nova-compute[75307]: iSNS:
Nov 13 23:17:03 user nova-compute[75307]: No targets found.
Nov 13 23:17:03 user nova-compute[75307]: STATIC:
Nov 13 23:17:03 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552
Nov 13 23:17:03 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:17:03 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:17:03 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:17:03 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:17:03 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:17:03 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:17:03 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:17:03 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:17:03 user nova-compute[75307]: FIRMWARE:
Nov 13 23:17:03 user nova-compute[75307]: No targets found.
Nov 13 23:17:03 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:17:03 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:17:03 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0865fb6-3683-4d42-917e-8dfc4391a681]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da8f9c8-40a0-4faf-944e-5315b6fb0477]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:17:03 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34339240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552'): ({'sdj'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Removing single pathed devices sdj {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[78002f6b-e9d5-465d-ab6e-344c2b0c9e92]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: INFO nova.compute.manager [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] [instance: 88f67d93-784c-4a3c-950a-f018df17dbf9] Took 2.44 seconds to detach 3 volumes for instance.
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17510f9-a596-447c-92fe-a3973793a30a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Flushing IO for device /dev/sdj {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f53643e-ec34-4223-9097-f485f16fc910]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bc4f93-ee75-4d14-adec-44f41993773e]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] SCSI volumes sdj have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aacf0c7-ef8b-4a3a-9aa0-6de9103bc733]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc53b870-273a-48d2-8732-c046176ba67e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260]
Nov 13 23:17:03 user nova-compute[75307]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552, portal: 172.16.0.220,3260] successful.
Nov 13 23:17:03 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8d3ee99-43ff-4c8f-9096-8e0d525d1552 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1565014-2ddc-4f76-bedc-8681f5dddf79]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] <== disconnect_volume: return (303ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:17:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:04 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Deleted allocations for instance 88f67d93-784c-4a3c-950a-f018df17dbf9
Nov 13 23:17:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f14b1273-c814-4413-8fb1-694148fc7cf8 tempest-TaggedBootDevicesTest_v242-1231581178 tempest-TaggedBootDevicesTest_v242-1231581178-project-member] Lock "88f67d93-784c-4a3c-950a-f018df17dbf9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.035s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:04 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lazy-loading 'flavor' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d919fb6c-2eb5-40ac-ab07-cc894549f7c3 tempest-VolumesAssistedSnapshotsTest-1641102447 tempest-VolumesAssistedSnapshotsTest-1641102447-project-admin] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.742s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdn (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdk (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:17:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:17:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7852MB free_disk=25.57067108154297GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e1e6da31-8158-4824-956b-c3f619dd06b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:17:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:17:13 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:13 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:13 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:17:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Waiting for libvirt event about the detach of device tapbb849627-f5 with device alias net1 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa is timed out.
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 13 23:17:17 user nova-compute[75307]:   <name>instance-00000007</name>
Nov 13 23:17:17 user nova-compute[75307]:   <uuid>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</uuid>
Nov 13 23:17:17 user nova-compute[75307]:   <metadata>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:17 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:16:24</nova:creationTime>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:17:17 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:ports>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="bb849627-f5fa-43f2-b070-1a5ec11a4d08">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.10.10.232" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:ports>
Nov 13 23:17:17 user nova-compute[75307]: </nova:instance>
Nov 13 23:17:17 user nova-compute[75307]:   </metadata>
Nov 13 23:17:17 user nova-compute[75307]:   <memory unit='KiB'>524288</memory>
Nov 13 23:17:17 user nova-compute[75307]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 23:17:17 user nova-compute[75307]:   <vcpu placement='static'>1</vcpu>
Nov 13 23:17:17 user nova-compute[75307]:   <resource>
Nov 13 23:17:17 user nova-compute[75307]:     <partition>/machine</partition>
Nov 13 23:17:17 user nova-compute[75307]:   </resource>
Nov 13 23:17:17 user nova-compute[75307]:   <sysinfo type='smbios'>
Nov 13 23:17:17 user nova-compute[75307]:     <system>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='version'>0.0.0</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='serial'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='uuid'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='family'>Virtual Machine</entry>
Nov 13 23:17:17 user nova-compute[75307]:     </system>
Nov 13 23:17:17 user nova-compute[75307]:   </sysinfo>
Nov 13 23:17:17 user nova-compute[75307]:   <os>
Nov 13 23:17:17 user nova-compute[75307]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 23:17:17 user nova-compute[75307]:     <boot dev='hd'/>
Nov 13 23:17:17 user nova-compute[75307]:     <smbios mode='sysinfo'/>
Nov 13 23:17:17 user nova-compute[75307]:   </os>
Nov 13 23:17:17 user nova-compute[75307]:   <features>
Nov 13 23:17:17 user nova-compute[75307]:     <acpi/>
Nov 13 23:17:17 user nova-compute[75307]:     <apic/>
Nov 13 23:17:17 user nova-compute[75307]:     <vmcoreinfo state='on'/>
Nov 13 23:17:17 user nova-compute[75307]:   </features>
Nov 13 23:17:17 user nova-compute[75307]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 23:17:17 user nova-compute[75307]:     <model fallback='forbid'>Nehalem</model>
Nov 13 23:17:17 user nova-compute[75307]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='vme'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='x2apic'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='hypervisor'/>
Nov 13 23:17:17 user nova-compute[75307]:   </cpu>
Nov 13 23:17:17 user nova-compute[75307]:   <clock offset='utc'>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='hpet' present='no'/>
Nov 13 23:17:17 user nova-compute[75307]:   </clock>
Nov 13 23:17:17 user nova-compute[75307]:   <on_poweroff>destroy</on_poweroff>
Nov 13 23:17:17 user nova-compute[75307]:   <on_reboot>restart</on_reboot>
Nov 13 23:17:17 user nova-compute[75307]:   <on_crash>destroy</on_crash>
Nov 13 23:17:17 user nova-compute[75307]:   <devices>
Nov 13 23:17:17 user nova-compute[75307]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='disk'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk' index='2'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore type='file' index='3'>
Nov 13 23:17:17 user nova-compute[75307]:         <format type='raw'/>
Nov 13 23:17:17 user nova-compute[75307]:         <source file='/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc'/>
Nov 13 23:17:17 user nova-compute[75307]:         <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       </backingStore>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='vda' bus='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='virtio-disk0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='cdrom'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config' index='1'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='hda' bus='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <readonly/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide0-0-0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='usb' index='0' model='none'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='usb'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='pci.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='ide' index='0'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <interface type='ethernet'>
Nov 13 23:17:17 user nova-compute[75307]:       <mac address='fa:16:3e:8a:94:82'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='tapfb7cdb1d-f0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <mtu size='1442'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='net0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </interface>
Nov 13 23:17:17 user nova-compute[75307]:     <serial type='pty'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='isa-serial' port='0'>
Nov 13 23:17:17 user nova-compute[75307]:         <model name='isa-serial'/>
Nov 13 23:17:17 user nova-compute[75307]:       </target>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </serial>
Nov 13 23:17:17 user nova-compute[75307]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='serial' port='0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </console>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='mouse' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='keyboard' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 23:17:17 user nova-compute[75307]:       <listen type='address' address='0.0.0.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </graphics>
Nov 13 23:17:17 user nova-compute[75307]:     <audio id='1' type='none'/>
Nov 13 23:17:17 user nova-compute[75307]:     <video>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='video0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </video>
Nov 13 23:17:17 user nova-compute[75307]:     <memballoon model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <stats period='10'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='balloon0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </memballoon>
Nov 13 23:17:17 user nova-compute[75307]:     <rng model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <backend model='random'>/dev/urandom</backend>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='rng0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </rng>
Nov 13 23:17:17 user nova-compute[75307]:   </devices>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>+64055:+108</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]: </domain>
Nov 13 23:17:17 user nova-compute[75307]:  {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 23:17:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully detached device tapbb849627-f5 from instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa from the live domain config.
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG os_vif [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb849627-f5, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfeabf29-f696-410a-8fc6-e6fd30136da8) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: INFO os_vif [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5')
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:17 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:17:17</nova:creationTime>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:17:17 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:ports>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:ports>
Nov 13 23:17:17 user nova-compute[75307]: </nova:instance>
Nov 13 23:17:17 user nova-compute[75307]:  {{(pid=75307) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-deleted-bb849627-f5fa-43f2-b070-1a5ec11a4d08 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:17 user nova-compute[75307]: INFO nova.compute.manager [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Neutron deleted interface bb849627-f5fa-43f2-b070-1a5ec11a4d08; detaching it from the instance and deleting it from the info cache
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquired lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.objects.instance [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Lazy-loading 'system_metadata' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.objects.instance [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Lazy-loading 'flavor' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.objects.base [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Object Instance<9ad3fd32-a8f8-48aa-a198-13bd6bf20caa> lazy-loaded attributes: system_metadata,flavor {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 13 23:17:17 user nova-compute[75307]:   <name>instance-00000007</name>
Nov 13 23:17:17 user nova-compute[75307]:   <uuid>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</uuid>
Nov 13 23:17:17 user nova-compute[75307]:   <metadata>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:17 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:17:17</nova:creationTime>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:17:17 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:ports>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:ports>
Nov 13 23:17:17 user nova-compute[75307]: </nova:instance>
Nov 13 23:17:17 user nova-compute[75307]:   </metadata>
Nov 13 23:17:17 user nova-compute[75307]:   <memory unit='KiB'>524288</memory>
Nov 13 23:17:17 user nova-compute[75307]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 23:17:17 user nova-compute[75307]:   <vcpu placement='static'>1</vcpu>
Nov 13 23:17:17 user nova-compute[75307]:   <resource>
Nov 13 23:17:17 user nova-compute[75307]:     <partition>/machine</partition>
Nov 13 23:17:17 user nova-compute[75307]:   </resource>
Nov 13 23:17:17 user nova-compute[75307]:   <sysinfo type='smbios'>
Nov 13 23:17:17 user nova-compute[75307]:     <system>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='version'>0.0.0</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='serial'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='uuid'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='family'>Virtual Machine</entry>
Nov 13 23:17:17 user nova-compute[75307]:     </system>
Nov 13 23:17:17 user nova-compute[75307]:   </sysinfo>
Nov 13 23:17:17 user nova-compute[75307]:   <os>
Nov 13 23:17:17 user nova-compute[75307]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 23:17:17 user nova-compute[75307]:     <boot dev='hd'/>
Nov 13 23:17:17 user nova-compute[75307]:     <smbios mode='sysinfo'/>
Nov 13 23:17:17 user nova-compute[75307]:   </os>
Nov 13 23:17:17 user nova-compute[75307]:   <features>
Nov 13 23:17:17 user nova-compute[75307]:     <acpi/>
Nov 13 23:17:17 user nova-compute[75307]:     <apic/>
Nov 13 23:17:17 user nova-compute[75307]:     <vmcoreinfo state='on'/>
Nov 13 23:17:17 user nova-compute[75307]:   </features>
Nov 13 23:17:17 user nova-compute[75307]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 23:17:17 user nova-compute[75307]:     <model fallback='forbid'>Nehalem</model>
Nov 13 23:17:17 user nova-compute[75307]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='vme'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='x2apic'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='hypervisor'/>
Nov 13 23:17:17 user nova-compute[75307]:   </cpu>
Nov 13 23:17:17 user nova-compute[75307]:   <clock offset='utc'>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='hpet' present='no'/>
Nov 13 23:17:17 user nova-compute[75307]:   </clock>
Nov 13 23:17:17 user nova-compute[75307]:   <on_poweroff>destroy</on_poweroff>
Nov 13 23:17:17 user nova-compute[75307]:   <on_reboot>restart</on_reboot>
Nov 13 23:17:17 user nova-compute[75307]:   <on_crash>destroy</on_crash>
Nov 13 23:17:17 user nova-compute[75307]:   <devices>
Nov 13 23:17:17 user nova-compute[75307]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='disk'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk' index='2'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore type='file' index='3'>
Nov 13 23:17:17 user nova-compute[75307]:         <format type='raw'/>
Nov 13 23:17:17 user nova-compute[75307]:         <source file='/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc'/>
Nov 13 23:17:17 user nova-compute[75307]:         <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       </backingStore>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='vda' bus='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='virtio-disk0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='cdrom'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config' index='1'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='hda' bus='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <readonly/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide0-0-0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='usb' index='0' model='none'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='usb'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='pci.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='ide' index='0'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <interface type='ethernet'>
Nov 13 23:17:17 user nova-compute[75307]:       <mac address='fa:16:3e:8a:94:82'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='tapfb7cdb1d-f0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <mtu size='1442'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='net0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </interface>
Nov 13 23:17:17 user nova-compute[75307]:     <serial type='pty'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='isa-serial' port='0'>
Nov 13 23:17:17 user nova-compute[75307]:         <model name='isa-serial'/>
Nov 13 23:17:17 user nova-compute[75307]:       </target>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </serial>
Nov 13 23:17:17 user nova-compute[75307]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='serial' port='0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </console>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='mouse' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='keyboard' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 23:17:17 user nova-compute[75307]:       <listen type='address' address='0.0.0.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </graphics>
Nov 13 23:17:17 user nova-compute[75307]:     <audio id='1' type='none'/>
Nov 13 23:17:17 user nova-compute[75307]:     <video>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='video0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </video>
Nov 13 23:17:17 user nova-compute[75307]:     <memballoon model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <stats period='10'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='balloon0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </memballoon>
Nov 13 23:17:17 user nova-compute[75307]:     <rng model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <backend model='random'>/dev/urandom</backend>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='rng0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </rng>
Nov 13 23:17:17 user nova-compute[75307]:   </devices>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>+64055:+108</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]: </domain>
Nov 13 23:17:17 user nova-compute[75307]:  {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface> {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:d5:e1:e3"/><model type="virtio"/><mtu size="1442"/><target dev="tapbb849627-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 13 23:17:17 user nova-compute[75307]:   <name>instance-00000007</name>
Nov 13 23:17:17 user nova-compute[75307]:   <uuid>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</uuid>
Nov 13 23:17:17 user nova-compute[75307]:   <metadata>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:17 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:17:17</nova:creationTime>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:17:17 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:ports>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:ports>
Nov 13 23:17:17 user nova-compute[75307]: </nova:instance>
Nov 13 23:17:17 user nova-compute[75307]:   </metadata>
Nov 13 23:17:17 user nova-compute[75307]:   <memory unit='KiB'>524288</memory>
Nov 13 23:17:17 user nova-compute[75307]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 13 23:17:17 user nova-compute[75307]:   <vcpu placement='static'>1</vcpu>
Nov 13 23:17:17 user nova-compute[75307]:   <resource>
Nov 13 23:17:17 user nova-compute[75307]:     <partition>/machine</partition>
Nov 13 23:17:17 user nova-compute[75307]:   </resource>
Nov 13 23:17:17 user nova-compute[75307]:   <sysinfo type='smbios'>
Nov 13 23:17:17 user nova-compute[75307]:     <system>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='product'>OpenStack Nova</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='version'>0.0.0</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='serial'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='uuid'>9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</entry>
Nov 13 23:17:17 user nova-compute[75307]:       <entry name='family'>Virtual Machine</entry>
Nov 13 23:17:17 user nova-compute[75307]:     </system>
Nov 13 23:17:17 user nova-compute[75307]:   </sysinfo>
Nov 13 23:17:17 user nova-compute[75307]:   <os>
Nov 13 23:17:17 user nova-compute[75307]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 13 23:17:17 user nova-compute[75307]:     <boot dev='hd'/>
Nov 13 23:17:17 user nova-compute[75307]:     <smbios mode='sysinfo'/>
Nov 13 23:17:17 user nova-compute[75307]:   </os>
Nov 13 23:17:17 user nova-compute[75307]:   <features>
Nov 13 23:17:17 user nova-compute[75307]:     <acpi/>
Nov 13 23:17:17 user nova-compute[75307]:     <apic/>
Nov 13 23:17:17 user nova-compute[75307]:     <vmcoreinfo state='on'/>
Nov 13 23:17:17 user nova-compute[75307]:   </features>
Nov 13 23:17:17 user nova-compute[75307]:   <cpu mode='custom' match='exact' check='full'>
Nov 13 23:17:17 user nova-compute[75307]:     <model fallback='forbid'>Nehalem</model>
Nov 13 23:17:17 user nova-compute[75307]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='vme'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='x2apic'/>
Nov 13 23:17:17 user nova-compute[75307]:     <feature policy='require' name='hypervisor'/>
Nov 13 23:17:17 user nova-compute[75307]:   </cpu>
Nov 13 23:17:17 user nova-compute[75307]:   <clock offset='utc'>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='pit' tickpolicy='delay'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 13 23:17:17 user nova-compute[75307]:     <timer name='hpet' present='no'/>
Nov 13 23:17:17 user nova-compute[75307]:   </clock>
Nov 13 23:17:17 user nova-compute[75307]:   <on_poweroff>destroy</on_poweroff>
Nov 13 23:17:17 user nova-compute[75307]:   <on_reboot>restart</on_reboot>
Nov 13 23:17:17 user nova-compute[75307]:   <on_crash>destroy</on_crash>
Nov 13 23:17:17 user nova-compute[75307]:   <devices>
Nov 13 23:17:17 user nova-compute[75307]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='disk'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk' index='2'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore type='file' index='3'>
Nov 13 23:17:17 user nova-compute[75307]:         <format type='raw'/>
Nov 13 23:17:17 user nova-compute[75307]:         <source file='/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc'/>
Nov 13 23:17:17 user nova-compute[75307]:         <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       </backingStore>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='vda' bus='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='virtio-disk0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <disk type='file' device='cdrom'>
Nov 13 23:17:17 user nova-compute[75307]:       <driver name='qemu' type='raw' cache='none'/>
Nov 13 23:17:17 user nova-compute[75307]:       <source file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/disk.config' index='1'/>
Nov 13 23:17:17 user nova-compute[75307]:       <backingStore/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='hda' bus='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <readonly/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide0-0-0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </disk>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='usb' index='0' model='none'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='usb'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='pci' index='0' model='pci-root'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='pci.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <controller type='ide' index='0'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='ide'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </controller>
Nov 13 23:17:17 user nova-compute[75307]:     <interface type='ethernet'>
Nov 13 23:17:17 user nova-compute[75307]:       <mac address='fa:16:3e:8a:94:82'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target dev='tapfb7cdb1d-f0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio'/>
Nov 13 23:17:17 user nova-compute[75307]:       <mtu size='1442'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='net0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </interface>
Nov 13 23:17:17 user nova-compute[75307]:     <serial type='pty'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='isa-serial' port='0'>
Nov 13 23:17:17 user nova-compute[75307]:         <model name='isa-serial'/>
Nov 13 23:17:17 user nova-compute[75307]:       </target>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </serial>
Nov 13 23:17:17 user nova-compute[75307]:     <console type='pty' tty='/dev/pts/5'>
Nov 13 23:17:17 user nova-compute[75307]:       <source path='/dev/pts/5'/>
Nov 13 23:17:17 user nova-compute[75307]:       <log file='/opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa/console.log' append='off'/>
Nov 13 23:17:17 user nova-compute[75307]:       <target type='serial' port='0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='serial0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </console>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='mouse' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <input type='keyboard' bus='ps2'>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='input1'/>
Nov 13 23:17:17 user nova-compute[75307]:     </input>
Nov 13 23:17:17 user nova-compute[75307]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 13 23:17:17 user nova-compute[75307]:       <listen type='address' address='0.0.0.0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </graphics>
Nov 13 23:17:17 user nova-compute[75307]:     <audio id='1' type='none'/>
Nov 13 23:17:17 user nova-compute[75307]:     <video>
Nov 13 23:17:17 user nova-compute[75307]:       <model type='virtio' heads='1' primary='yes'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='video0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </video>
Nov 13 23:17:17 user nova-compute[75307]:     <memballoon model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <stats period='10'/>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='balloon0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </memballoon>
Nov 13 23:17:17 user nova-compute[75307]:     <rng model='virtio'>
Nov 13 23:17:17 user nova-compute[75307]:       <backend model='random'>/dev/urandom</backend>
Nov 13 23:17:17 user nova-compute[75307]:       <alias name='rng0'/>
Nov 13 23:17:17 user nova-compute[75307]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 13 23:17:17 user nova-compute[75307]:     </rng>
Nov 13 23:17:17 user nova-compute[75307]:   </devices>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>libvirt-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 13 23:17:17 user nova-compute[75307]:     <label>+64055:+108</label>
Nov 13 23:17:17 user nova-compute[75307]:     <imagelabel>+64055:+108</imagelabel>
Nov 13 23:17:17 user nova-compute[75307]:   </seclabel>
Nov 13 23:17:17 user nova-compute[75307]: </domain>
Nov 13 23:17:17 user nova-compute[75307]:  {{(pid=75307) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 13 23:17:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Detaching interface fa:16:3e:d5:e1:e3 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapbb849627-f5' not found.
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Converting VIF {"id": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "address": "fa:16:3e:d5:e1:e3", "network": {"id": "e00e2943-5d5f-46dd-9271-42b0694a154e", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-737687120", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.232", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb849627-f5", "ovs_interfaceid": "bb849627-f5fa-43f2-b070-1a5ec11a4d08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG os_vif [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb849627-f5, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:17:17 user nova-compute[75307]: INFO os_vif [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:e1:e3,bridge_name='br-int',has_traffic_filtering=True,id=bb849627-f5fa-43f2-b070-1a5ec11a4d08,network=Network(e00e2943-5d5f-46dd-9271-42b0694a154e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbb849627-f5')
Nov 13 23:17:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [req-354cee23-fc89-433e-aa4c-fedf754da205 req-3e5eb2bc-af74-47f6-9259-6d29afe4e3e4 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:17 user nova-compute[75307]:   <nova:package version="0.0.0"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:name>tempest-device-tagging-server-1906504202</nova:name>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:creationTime>2023-11-13 23:17:17</nova:creationTime>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:flavor name="m1.tiny">
Nov 13 23:17:17 user nova-compute[75307]:     <nova:memory>512</nova:memory>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:disk>1</nova:disk>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:swap>0</nova:swap>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:flavor>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:user uuid="94ade1329f384250a9d4bfb46663af88">tempest-TaggedAttachmentsTest-1130310573-project-member</nova:user>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:project uuid="cb004021b8aa4795b049ebad0d119f84">tempest-TaggedAttachmentsTest-1130310573</nova:project>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:owner>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:17 user nova-compute[75307]:   <nova:ports>
Nov 13 23:17:17 user nova-compute[75307]:     <nova:port uuid="fb7cdb1d-f098-4652-af97-d7ad34850018">
Nov 13 23:17:17 user nova-compute[75307]:       <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:17:17 user nova-compute[75307]:     </nova:port>
Nov 13 23:17:17 user nova-compute[75307]:   </nova:ports>
Nov 13 23:17:17 user nova-compute[75307]: </nova:instance>
Nov 13 23:17:17 user nova-compute[75307]:  {{(pid=75307) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 13 23:17:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [{"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Releasing lock "refresh_cache-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:17:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf369ed-b550-481c-8fce-9717e13c9eb8 tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "interface-9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-bb849627-f5fa-43f2-b070-1a5ec11a4d08" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.675s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:17:19 user nova-compute[75307]: INFO nova.compute.claims [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Claim successful on node user
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:17:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:17:19 user nova-compute[75307]: DEBUG nova.policy [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6962721fd5104239bdd55f20fd7dc702', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa6bf881a2474024a7f84cc5b93d440e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:17:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Creating image(s)
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "/opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "/opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "/opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.211s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Successfully created port: 1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk 1073741824" returned: 0 in 0.067s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.218s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Checking if we can resize image /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Cannot resize image /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Ensure instance console log exists: /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Successfully updated port: 1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquired lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-changed-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Refreshing instance network info cache due to event network-changed-1235dc02-43da-4806-84e2-16d065cfdcb2. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] Acquiring lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Updating instance_info_cache with network_info: [{"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Releasing lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Instance network_info: |[{"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] Acquired lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.neutron [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Refreshing network info cache for port 1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Start _get_guest_xml network_info=[{"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:17:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:17:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1585767879',display_name='tempest-VolumesAdminNegativeTest-server-1585767879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1585767879',id=13,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-0yrnxj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:17:20Z,user_data=None,user_id='6962721fd5104239bdd55f20fd7dc702',uuid=245c74b2-6792-4e9f-8bbe-4426e4b32df8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'pci_devices' on Instance uuid 245c74b2-6792-4e9f-8bbe-4426e4b32df8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:17:21 user nova-compute[75307]:   <uuid>245c74b2-6792-4e9f-8bbe-4426e4b32df8</uuid>
Nov 13 23:17:21 user nova-compute[75307]:   <name>instance-0000000d</name>
Nov 13 23:17:21 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:17:21 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:17:21 user nova-compute[75307]:   <metadata>
Nov 13 23:17:21 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:17:21 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1585767879</nova:name>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:17:21</nova:creationTime>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:17:21 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:17:21 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:owner>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:user uuid="6962721fd5104239bdd55f20fd7dc702">tempest-VolumesAdminNegativeTest-265333520-project-member</nova:user>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:project uuid="aa6bf881a2474024a7f84cc5b93d440e">tempest-VolumesAdminNegativeTest-265333520</nova:project>
Nov 13 23:17:21 user nova-compute[75307]:       </nova:owner>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:17:21 user nova-compute[75307]:       <nova:ports>
Nov 13 23:17:21 user nova-compute[75307]:         <nova:port uuid="1235dc02-43da-4806-84e2-16d065cfdcb2">
Nov 13 23:17:21 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:17:21 user nova-compute[75307]:         </nova:port>
Nov 13 23:17:21 user nova-compute[75307]:       </nova:ports>
Nov 13 23:17:21 user nova-compute[75307]:     </nova:instance>
Nov 13 23:17:21 user nova-compute[75307]:   </metadata>
Nov 13 23:17:21 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:17:21 user nova-compute[75307]:     <system>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="serial">245c74b2-6792-4e9f-8bbe-4426e4b32df8</entry>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="uuid">245c74b2-6792-4e9f-8bbe-4426e4b32df8</entry>
Nov 13 23:17:21 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:17:21 user nova-compute[75307]:     </system>
Nov 13 23:17:21 user nova-compute[75307]:   </sysinfo>
Nov 13 23:17:21 user nova-compute[75307]:   <os>
Nov 13 23:17:21 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:17:21 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:17:21 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:17:21 user nova-compute[75307]:   </os>
Nov 13 23:17:21 user nova-compute[75307]:   <features>
Nov 13 23:17:21 user nova-compute[75307]:     <acpi/>
Nov 13 23:17:21 user nova-compute[75307]:     <apic/>
Nov 13 23:17:21 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:17:21 user nova-compute[75307]:   </features>
Nov 13 23:17:21 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:17:21 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:17:21 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:17:21 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:17:21 user nova-compute[75307]:   </clock>
Nov 13 23:17:21 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:17:21 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:17:21 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:17:21 user nova-compute[75307]:   </cpu>
Nov 13 23:17:21 user nova-compute[75307]:   <devices>
Nov 13 23:17:21 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:17:21 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:17:21 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk"/>
Nov 13 23:17:21 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:17:21 user nova-compute[75307]:     </disk>
Nov 13 23:17:21 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:17:21 user nova-compute[75307]:       <mac address="fa:16:3e:bb:83:11"/>
Nov 13 23:17:21 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:17:21 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:17:21 user nova-compute[75307]:       <target dev="tap1235dc02-43"/>
Nov 13 23:17:21 user nova-compute[75307]:     </interface>
Nov 13 23:17:21 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:17:21 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/console.log" append="off"/>
Nov 13 23:17:21 user nova-compute[75307]:     </serial>
Nov 13 23:17:21 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:17:21 user nova-compute[75307]:     <video>
Nov 13 23:17:21 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:17:21 user nova-compute[75307]:     </video>
Nov 13 23:17:21 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:17:21 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:17:21 user nova-compute[75307]:     </rng>
Nov 13 23:17:21 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:17:21 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:17:21 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:17:21 user nova-compute[75307]:     </memballoon>
Nov 13 23:17:21 user nova-compute[75307]:   </devices>
Nov 13 23:17:21 user nova-compute[75307]: </domain>
Nov 13 23:17:21 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1585767879',display_name='tempest-VolumesAdminNegativeTest-server-1585767879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1585767879',id=13,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-0yrnxj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:17:20Z,user_data=None,user_id='6962721fd5104239bdd55f20fd7dc702',uuid=245c74b2-6792-4e9f-8bbe-4426e4b32df8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG os_vif [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '907372c6-39e0-562d-93e2-dfdab62dbf6b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1235dc02-43, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1235dc02-43, col_values=(('qos', UUID('cf2d1faa-eb6e-4c99-9bd0-e50d028c101c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1235dc02-43, col_values=(('external_ids', {'iface-id': '1235dc02-43da-4806-84e2-16d065cfdcb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:83:11', 'vm-uuid': '245c74b2-6792-4e9f-8bbe-4426e4b32df8'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:21 user nova-compute[75307]: INFO os_vif [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43')
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:17:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] No VIF found with MAC fa:16:3e:bb:83:11, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:17:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Updated VIF entry in instance network info cache for port 1235dc02-43da-4806-84e2-16d065cfdcb2. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:17:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Updating instance_info_cache with network_info: [{"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e755fa25-2088-4a15-a8a3-06360f72b4a6 req-e418f8a7-d804-4a8e-b6bd-a3007bbf2956 service nova] Releasing lock "refresh_cache-245c74b2-6792-4e9f-8bbe-4426e4b32df8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:23 user nova-compute[75307]: WARNING nova.compute.manager [req-1b233b6a-d720-403d-b420-36b05637cabd req-034ed9bf-0432-458a-9f6d-2dfebac970e7 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state building and task_state spawning.
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:17:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Instance spawned successfully.
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:17:25 user nova-compute[75307]: INFO nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Took 5.36 seconds to spawn the instance on the hypervisor.
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:25 user nova-compute[75307]: WARNING nova.compute.manager [req-220755bb-42e4-47b5-b34f-ddee573e95fd req-c4e50f43-7f3d-4964-abe6-541bf99885b1 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state building and task_state spawning.
Nov 13 23:17:25 user nova-compute[75307]: INFO nova.compute.manager [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Took 6.21 seconds to build instance.
Nov 13 23:17:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d23a7096-4dfa-4afc-897e-e6f194d9b890 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.303s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:17:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:35 user nova-compute[75307]: INFO nova.compute.manager [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Terminating instance
Nov 13 23:17:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-unplugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] No waiting events found dispatching network-vif-unplugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-66fdd8eb-07c2-4f6c-9806-d279f736d8f8 req-d565db09-5acc-4ad0-9a73-930c3fc40871 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-unplugged-800034b9-e021-423d-baea-389a08093ef6 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:17:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Instance destroyed successfully.
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.objects.instance [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lazy-loading 'resources' on Instance uuid e1e6da31-8158-4824-956b-c3f619dd06b4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-485170644',display_name='tempest-VolumesAssistedSnapshotsTest-server-485170644',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-485170644',id=9,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGkEOn8LipOSoXDVlFPK1HYi9pBEu5pJtuCIusBUEV3LXOI05dJsQ2P8EFSu35bdQ/w+DXxzhgMA4yYH79WNw0knWrJVbuT4SmQMmEOqQRY5cGXq9kNjCWvExaaHLyj4kg==',key_name='tempest-keypair-1574687254',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4bf67291c7c44e33b44c9cfdf765b794',ramdisk_id='',reservation_id='r-mlvwqhn5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1068930723',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1068930723-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5e011923791740f786db97bbb6df72b5',uuid=e1e6da31-8158-4824-956b-c3f619dd06b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converting VIF {"id": "800034b9-e021-423d-baea-389a08093ef6", "address": "fa:16:3e:cc:6a:6c", "network": {"id": "8098e89b-2a4d-46e8-add2-2e6b284de5cd", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1944895817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4bf67291c7c44e33b44c9cfdf765b794", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap800034b9-e0", "ovs_interfaceid": "800034b9-e021-423d-baea-389a08093ef6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG os_vif [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap800034b9-e0, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ffa1179-676e-46e2-b1f7-c612ed26240c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:36 user nova-compute[75307]: INFO os_vif [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6a:6c,bridge_name='br-int',has_traffic_filtering=True,id=800034b9-e021-423d-baea-389a08093ef6,network=Network(8098e89b-2a4d-46e8-add2-2e6b284de5cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap800034b9-e0')
Nov 13 23:17:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Deleting instance files /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4_del
Nov 13 23:17:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Deletion of /opt/stack/data/nova/instances/e1e6da31-8158-4824-956b-c3f619dd06b4_del complete
Nov 13 23:17:36 user nova-compute[75307]: INFO nova.compute.manager [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 23:17:36 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:17:36 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:37 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Took 0.72 seconds to deallocate network for instance.
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9b5fa50-ae24-471e-ab00-ba24aad7eb0a req-cb28ddc0-382e-4712-aed8-bd1a4a4f0a09 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-deleted-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:37 user nova-compute[75307]: INFO nova.compute.manager [req-f9b5fa50-ae24-471e-ab00-ba24aad7eb0a req-cb28ddc0-382e-4712-aed8-bd1a4a4f0a09 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Neutron deleted interface 800034b9-e021-423d-baea-389a08093ef6; detaching it from the instance and deleting it from the info cache
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-f9b5fa50-ae24-471e-ab00-ba24aad7eb0a req-cb28ddc0-382e-4712-aed8-bd1a4a4f0a09 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9b5fa50-ae24-471e-ab00-ba24aad7eb0a req-cb28ddc0-382e-4712-aed8-bd1a4a4f0a09 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Detach interface failed, port_id=800034b9-e021-423d-baea-389a08093ef6, reason: Instance e1e6da31-8158-4824-956b-c3f619dd06b4 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:37 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Deleted allocations for instance e1e6da31-8158-4824-956b-c3f619dd06b4
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-19dae3df-937c-48df-a568-466b514ddb33 tempest-VolumesAssistedSnapshotsTest-1068930723 tempest-VolumesAssistedSnapshotsTest-1068930723-project-member] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.313s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] Acquiring lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] Lock "e1e6da31-8158-4824-956b-c3f619dd06b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] No waiting events found dispatching network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:37 user nova-compute[75307]: WARNING nova.compute.manager [req-0850c76b-2d9c-4279-8e6c-7cb5805460d2 req-f2db32f1-e6d5-499c-8a9b-47e19c690a39 service nova] [instance: e1e6da31-8158-4824-956b-c3f619dd06b4] Received unexpected event network-vif-plugged-800034b9-e021-423d-baea-389a08093ef6 for instance with vm_state deleted and task_state None.
Nov 13 23:17:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:47 user nova-compute[75307]: INFO nova.compute.manager [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Terminating instance
Nov 13 23:17:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-unplugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-unplugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-a62670cf-a6c5-4129-ab39-1bc3d5e3ba65 req-833c443b-ae6f-49e3-979a-a810c753fc97 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-unplugged-fb7cdb1d-f098-4652-af97-d7ad34850018 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:17:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Instance destroyed successfully.
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lazy-loading 'resources' on Instance uuid 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-13T23:14:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1906504202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1906504202',id=7,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKWrFH0Q0/hM7b3g3oXEHXsv9jVZ5eDrE8kUbxiiktX7Eqbtlqgo9ML2msB8S/y0VUn0aGqxWmRAo8Av8gZYr2Wx9u2GCZHvnH3XtpJmC1RavWXMoc3JivhVRMaiHq/hSg==',key_name='tempest-keypair-1425816845',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb004021b8aa4795b049ebad0d119f84',ramdisk_id='',reservation_id='r-1awdo229',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1130310573',owner_user_name='tempest-TaggedAttachmentsTest-1130310573-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='94ade1329f384250a9d4bfb46663af88',uuid=9ad3fd32-a8f8-48aa-a198-13bd6bf20caa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converting VIF {"id": "fb7cdb1d-f098-4652-af97-d7ad34850018", "address": "fa:16:3e:8a:94:82", "network": {"id": "3a73ffc0-9577-4a62-931b-23d2e50d4eee", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-408617213-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb004021b8aa4795b049ebad0d119f84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfb7cdb1d-f0", "ovs_interfaceid": "fb7cdb1d-f098-4652-af97-d7ad34850018", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG os_vif [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfb7cdb1d-f0, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68f36ebb-2e09-45c0-a4f8-96a4d776edb5) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:48 user nova-compute[75307]: INFO os_vif [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:94:82,bridge_name='br-int',has_traffic_filtering=True,id=fb7cdb1d-f098-4652-af97-d7ad34850018,network=Network(3a73ffc0-9577-4a62-931b-23d2e50d4eee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfb7cdb1d-f0')
Nov 13 23:17:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Deleting instance files /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa_del
Nov 13 23:17:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Deletion of /opt/stack/data/nova/instances/9ad3fd32-a8f8-48aa-a198-13bd6bf20caa_del complete
Nov 13 23:17:48 user nova-compute[75307]: INFO nova.compute.manager [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 13 23:17:48 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:17:48 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:17:49 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:49 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Took 1.12 seconds to deallocate network for instance.
Nov 13 23:17:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-7c628494-cf13-441f-9dea-27a666eb9feb req-5d0d2abb-0cdf-4433-8501-a6e3585d72bf service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-deleted-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] Acquiring lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] No waiting events found dispatching network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:17:50 user nova-compute[75307]: WARNING nova.compute.manager [req-1a592bb6-40a7-46b0-a115-f6c4c806e0b4 req-8e380077-0dab-496b-9e52-5d6214d956a1 service nova] [instance: 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa] Received unexpected event network-vif-plugged-fb7cdb1d-f098-4652-af97-d7ad34850018 for instance with vm_state deleted and task_state None.
Nov 13 23:17:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:50 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Deleted allocations for instance 9ad3fd32-a8f8-48aa-a198-13bd6bf20caa
Nov 13 23:17:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-089a4be4-e910-4fd4-a31c-880f54a1891f tempest-TaggedAttachmentsTest-1130310573 tempest-TaggedAttachmentsTest-1130310573-project-member] Lock "9ad3fd32-a8f8-48aa-a198-13bd6bf20caa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.887s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:17:58 user nova-compute[75307]: INFO nova.compute.claims [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Claim successful on node user
Nov 13 23:17:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:17:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'info_cache' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:17:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:17:59 user nova-compute[75307]: INFO nova.virt.block_device [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Booting with volume 8d69a3ef-fd1f-4d95-87b6-abfada00d66d at /dev/vda
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.utils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd69c2ab-a477-4392-aeac-29ee67b476a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc4bdff-91e3-45b5-85a6-7372577ac8b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b742c7d1-d0ea-48b9-9e9d-0f50a298dba1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7d3022-77f6-44c9-87aa-575edec8174c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:17:59 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a610da-eb65-44ca-bc11-0d8323c579c4]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG os_brick.utils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updating existing volume attachment record: a9d312e2-873a-4d57-af45-addafab78294 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.policy [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:17:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:17:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance destroyed successfully.
Nov 13 23:17:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'resources' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6511cea-1a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=887d58b7-3673-4b65-891f-963455df55da) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:00 user nova-compute[75307]: INFO os_vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:18:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fbb560-aae4-4698-90ac-905d66f68e87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:18:00 user nova-compute[75307]: No targets found.
Nov 13 23:18:00 user nova-compute[75307]: iSNS:
Nov 13 23:18:00 user nova-compute[75307]: No targets found.
Nov 13 23:18:00 user nova-compute[75307]: STATIC:
Nov 13 23:18:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:18:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:18:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:18:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:18:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:18:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:18:00 user nova-compute[75307]: FIRMWARE:
Nov 13 23:18:00 user nova-compute[75307]: No targets found.
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:18:00 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:18:00 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c992db8d-5c42-46c8-a677-6e5a3e3be310]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df1f2aa6-7475-4d5f-9b79-52ad6bcf6349]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34341c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3'): ({'sdk'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Removing single pathed devices sdk {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e184d145-e64f-49f5-85c9-32b8b91daa40]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e206b5-37e0-4f47-b4b7-723ca6f12492]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flushing IO for device /dev/sdk {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[103061a8-f019-4055-93a0-7a1a04b7f970]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.048s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9675a6-43e5-4ffb-bc66-9623435af39c]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] SCSI volumes sdk have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d4fb96-0859-4331-85ae-90ee851dc5bd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dab33f-fe24-45ec-9908-607059eb0505]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]
Nov 13 23:18:00 user nova-compute[75307]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b745d33-2580-46ed-bacb-c8179518e758]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== disconnect_volume: return (338ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start _get_guest_xml network_info=[{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, 'status': 'reserved', 'instance': 'fdc18eac-a300-4f89-8621-2075decfec01', 'attached_at': '', 'detached_at': '', 'volume_id': '2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'serial': '2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3'}, 'delete_on_termination': False, 'attachment_id': '4ffab908-5f2a-4c6b-8cfb-5d0ded2917f7', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'numa_topology' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:18:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:00 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e13206f-2b4a-4ed0-91ed-434b1ca73c57]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:18:00 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f0c61c-b777-4382-80e9-05d04ddbe96e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3] added
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecbd8a28-76d2-45e2-823b-6df244863fce]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa08c9-8371-4f65-9812-34c0b9252990]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOsiBCvZ {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EOsiBCvZ" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa79c00f-7306-49a4-ae9c-f59d5bea5c63]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EOsiBCvZ'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[467e9e0d-6cb5-4e72-a675-381c88658c3b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc713879-4258-405e-a59c-62aba66e51ef]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85710a4c-04e8-4fe8-a7dd-07f2bc30bb47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]
Nov 13 23:18:00 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7c39425-debb-4a6e-8438-45f65f32273d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4bde81-ffc4-4b9a-9f92-7e29c4aff04e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76eab2c-fc68-47b3-ace2-026fe4ecbd95]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Successfully created port: da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23530383166306633', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530383166306633', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:01 user nova-compute[75307]:   <uuid>fdc18eac-a300-4f89-8621-2075decfec01</uuid>
Nov 13 23:18:01 user nova-compute[75307]:   <name>instance-00000004</name>
Nov 13 23:18:01 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:01 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:01 user nova-compute[75307]:   <metadata>
Nov 13 23:18:01 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:01 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeTestJSON-server-15052950</nova:name>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:00</nova:creationTime>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:01 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:01 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:user uuid="19d8c9bb553d4995bc62521ef2b8bf0b">tempest-AttachVolumeTestJSON-1230084994-project-member</nova:user>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:project uuid="e387a1f37b944329bb8f097e8f4ec56b">tempest-AttachVolumeTestJSON-1230084994</nova:project>
Nov 13 23:18:01 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:18:01 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:01 user nova-compute[75307]:         <nova:port uuid="d6511cea-1a73-4612-bd4b-5a50bd96a3b1">
Nov 13 23:18:01 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 23:18:01 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:01 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:01 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:01 user nova-compute[75307]:   </metadata>
Nov 13 23:18:01 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:01 user nova-compute[75307]:     <system>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="serial">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="uuid">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:18:01 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:01 user nova-compute[75307]:     </system>
Nov 13 23:18:01 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:01 user nova-compute[75307]:   <os>
Nov 13 23:18:01 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:01 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:18:01 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:01 user nova-compute[75307]:   </os>
Nov 13 23:18:01 user nova-compute[75307]:   <features>
Nov 13 23:18:01 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:01 user nova-compute[75307]:     <apic/>
Nov 13 23:18:01 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:01 user nova-compute[75307]:   </features>
Nov 13 23:18:01 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:01 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:01 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:01 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:01 user nova-compute[75307]:   </clock>
Nov 13 23:18:01 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:01 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:01 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:01 user nova-compute[75307]:   </cpu>
Nov 13 23:18:01 user nova-compute[75307]:   <devices>
Nov 13 23:18:01 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:01 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:01 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk"/>
Nov 13 23:18:01 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:01 user nova-compute[75307]:     </disk>
Nov 13 23:18:01 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:18:01 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:18:01 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:18:01 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:18:01 user nova-compute[75307]:       <serial>2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3</serial>
Nov 13 23:18:01 user nova-compute[75307]:     </disk>
Nov 13 23:18:01 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:01 user nova-compute[75307]:       <mac address="fa:16:3e:7a:10:97"/>
Nov 13 23:18:01 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:01 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:01 user nova-compute[75307]:       <target dev="tapd6511cea-1a"/>
Nov 13 23:18:01 user nova-compute[75307]:     </interface>
Nov 13 23:18:01 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:01 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/console.log" append="off"/>
Nov 13 23:18:01 user nova-compute[75307]:     </serial>
Nov 13 23:18:01 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:01 user nova-compute[75307]:     <video>
Nov 13 23:18:01 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:01 user nova-compute[75307]:     </video>
Nov 13 23:18:01 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:01 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:01 user nova-compute[75307]:     </rng>
Nov 13 23:18:01 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:01 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:01 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:01 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:01 user nova-compute[75307]:   </devices>
Nov 13 23:18:01 user nova-compute[75307]: </domain>
Nov 13 23:18:01 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.214s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Successfully updated port: da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-changed-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Refreshing instance network info cache due to event network-changed-da729a35-f81c-4005-a179-a06292942c86. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] Acquiring lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Cannot resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.objects.instance [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'migration_context' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.objects.base [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG os_vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c85ed381-5f23-5e82-8706-361ec19d4164', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6511cea-1a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6511cea-1a, col_values=(('qos', UUID('0c566a2a-08d5-4391-9bf0-c8ccb2ce1270')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6511cea-1a, col_values=(('external_ids', {'iface-id': 'd6511cea-1a73-4612-bd4b-5a50bd96a3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:10:97', 'vm-uuid': 'fdc18eac-a300-4f89-8621-2075decfec01'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:02 user nova-compute[75307]: INFO os_vif [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:18:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updating instance_info_cache with network_info: [{"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Instance network_info: |[{"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:18:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] Acquired lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Refreshing network info cache for port da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:18:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updated VIF entry in instance network info cache for port da729a35-f81c-4005-a179-a06292942c86. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updating instance_info_cache with network_info: [{"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f741657f-d35a-4d7e-aaf4-c013a0601aa6 req-ca3412b4-d71f-40a5-9e1c-a6c3f0718eb4 service nova] Releasing lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:18:04 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Creating image(s)
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Ensure instance console log exists: /opt/stack/data/nova/instances/d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Start _get_guest_xml network_info=[{"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRkPypDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd7ae850e-d8ce-4641-8dfb-bebc6fc57bdb', 'attached_at': '', 'detached_at': '', 'volume_id': '8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 'serial': '8d69a3ef-fd1f-4d95-87b6-abfada00d66d'}, 'delete_on_termination': True, 'attachment_id': 'a9d312e2-873a-4d57-af45-addafab78294', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:04 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:04 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRkPypDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:18:04 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:04 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:04 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bee061-af4b-49b7-a622-23b9c1bb90e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:18:04 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f386d-dda0-47ed-bdbc-c017e14b7cb2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d] added
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[187f79c3-e9d2-43c5-b5b1-65ff3822c6e3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc1cf99-b938-42ca-9a29-bc1774a77200]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRkPypDV {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRkPypDV" returned: 0 in 0.050s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5ff52e-64c4-4cc3-baef-5b9b9d6ade7a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRkPypDV'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb10f502-5ec9-4145-be19-ebd78168fd5f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39a1226-3b7f-4d5f-87bd-e44da97e425e]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3e40a5-f39f-4856-bb43-d827f75bb1b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260]
Nov 13 23:18:04 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260] successful.
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d3e6a7-b933-48ac-ba6a-0497dea40fe6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80727fbc-4193-4ceb-a707-74f5ce59821d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:04 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:18:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('34', '-', '-', 0) found on session 19 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdb554a-e9f6-4e22-be13-dd523d2ffc7a]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 19 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRkPypDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '26539656664633362', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539656664633362', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2009755200',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCalIwlidrHtfzsLxpRBUQ6l/s7uQaDs2dJseBpVgSx8ViBsfXK2P3DxRZtVmkC6Uo4tZsLoNGVpfNW6VMU5GdzmALQnysHxmjrQHmWg0KF0jFwtdxcEGn7jSkx599XCGQ==',key_name='tempest-keypair-1797345135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-os5dk1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:05 user nova-compute[75307]:   <uuid>d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb</uuid>
Nov 13 23:18:05 user nova-compute[75307]:   <name>instance-0000000e</name>
Nov 13 23:18:05 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:05 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:05 user nova-compute[75307]:   <metadata>
Nov 13 23:18:05 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:05 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:05 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2009755200</nova:name>
Nov 13 23:18:05 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:04</nova:creationTime>
Nov 13 23:18:05 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:05 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:05 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:05 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:18:05 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:05 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:05 user nova-compute[75307]:         <nova:port uuid="da729a35-f81c-4005-a179-a06292942c86">
Nov 13 23:18:05 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:18:05 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:05 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:05 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:05 user nova-compute[75307]:   </metadata>
Nov 13 23:18:05 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:05 user nova-compute[75307]:     <system>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="serial">d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb</entry>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="uuid">d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb</entry>
Nov 13 23:18:05 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:05 user nova-compute[75307]:     </system>
Nov 13 23:18:05 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:05 user nova-compute[75307]:   <os>
Nov 13 23:18:05 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:05 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:18:05 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:05 user nova-compute[75307]:   </os>
Nov 13 23:18:05 user nova-compute[75307]:   <features>
Nov 13 23:18:05 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:05 user nova-compute[75307]:     <apic/>
Nov 13 23:18:05 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:05 user nova-compute[75307]:   </features>
Nov 13 23:18:05 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:05 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:05 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:05 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:05 user nova-compute[75307]:   </clock>
Nov 13 23:18:05 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:05 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:05 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:05 user nova-compute[75307]:   </cpu>
Nov 13 23:18:05 user nova-compute[75307]:   <devices>
Nov 13 23:18:05 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:18:05 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:18:05 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:18:05 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:05 user nova-compute[75307]:       <serial>8d69a3ef-fd1f-4d95-87b6-abfada00d66d</serial>
Nov 13 23:18:05 user nova-compute[75307]:     </disk>
Nov 13 23:18:05 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:05 user nova-compute[75307]:       <mac address="fa:16:3e:8a:d2:7b"/>
Nov 13 23:18:05 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:05 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:05 user nova-compute[75307]:       <target dev="tapda729a35-f8"/>
Nov 13 23:18:05 user nova-compute[75307]:     </interface>
Nov 13 23:18:05 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:05 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb/console.log" append="off"/>
Nov 13 23:18:05 user nova-compute[75307]:     </serial>
Nov 13 23:18:05 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:05 user nova-compute[75307]:     <video>
Nov 13 23:18:05 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:05 user nova-compute[75307]:     </video>
Nov 13 23:18:05 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:05 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:05 user nova-compute[75307]:     </rng>
Nov 13 23:18:05 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:05 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:05 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:05 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:05 user nova-compute[75307]:   </devices>
Nov 13 23:18:05 user nova-compute[75307]: </domain>
Nov 13 23:18:05 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2009755200',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCalIwlidrHtfzsLxpRBUQ6l/s7uQaDs2dJseBpVgSx8ViBsfXK2P3DxRZtVmkC6Uo4tZsLoNGVpfNW6VMU5GdzmALQnysHxmjrQHmWg0KF0jFwtdxcEGn7jSkx599XCGQ==',key_name='tempest-keypair-1797345135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-os5dk1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:17:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG os_vif [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d9ac3fe-edff-58e9-9b97-667ee12cf1d2', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda729a35-f8, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda729a35-f8, col_values=(('qos', UUID('ab23a737-a562-4394-8a8e-5c4fdf013846')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda729a35-f8, col_values=(('external_ids', {'iface-id': 'da729a35-f81c-4005-a179-a06292942c86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:d2:7b', 'vm-uuid': 'd7ae850e-d8ce-4641-8dfb-bebc6fc57bdb'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:05 user nova-compute[75307]: INFO os_vif [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8')
Nov 13 23:18:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:8a:d2:7b, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:18:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:18:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance rebooted successfully.
Nov 13 23:18:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-da531ce7-03a3-4d36-ad43-692024f9fe91 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:07 user nova-compute[75307]: WARNING nova.compute.manager [req-34a18b25-d5aa-4dd6-a1a9-c519b3b6b5eb req-a04a8d96-ba4e-4b82-ace1-65bdddb4b819 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state active and task_state None.
Nov 13 23:18:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:18:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:09 user nova-compute[75307]: WARNING nova.compute.manager [req-a7ace940-fcba-475f-a4a8-6f8c192355b1 req-7a310c8f-a5ae-4530-8657-16f3c27b53e0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state active and task_state None.
Nov 13 23:18:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdn (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:18:10 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Instance spawned successfully.
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:10 user nova-compute[75307]: INFO nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Took 6.07 seconds to spawn the instance on the hypervisor.
Nov 13 23:18:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:10 user nova-compute[75307]: INFO nova.compute.manager [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Took 12.41 seconds to build instance.
Nov 13 23:18:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6253de9e-f726-42d1-9dc4-f77a3d2d74dd tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.539s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.232s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] No waiting events found dispatching network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:11 user nova-compute[75307]: WARNING nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received unexpected event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 for instance with vm_state active and task_state None.
Nov 13 23:18:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] No waiting events found dispatching network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:11 user nova-compute[75307]: WARNING nova.compute.manager [req-90500f0a-ce45-425b-9eab-92200da10118 req-72c12499-cc55-4033-9ddf-b679fb6562b7 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received unexpected event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 for instance with vm_state active and task_state None.
Nov 13 23:18:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:12 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=25.6136474609375GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 245c74b2-6792-4e9f-8bbe-4426e4b32df8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:12 user nova-compute[75307]: INFO nova.compute.manager [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Terminating instance
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:18:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Instance destroyed successfully.
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lazy-loading 'resources' on Instance uuid f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:14:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1899693339',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-732987275',id=6,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO3xP5tsS0n7x4JraMwXUXFjjXQI6UnDW1kJB2OOgOoMHPsvtYnTAC6wQJHejsZ3i2FZRsQaw8MidaV4uPZlSDyjNeVDTaCrVgREvdPMTwSOJjdCK7KQYV/MjRTDvQJ/EQ==',key_name='tempest-keypair-2107033266',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:16:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f06c812f7eb14d6787f160b2c9e0c7f8',ramdisk_id='',reservation_id='r-sazqo4cc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1262901442',owner_user_name='tempest-ServerActionsV293TestJSON-1262901442-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:16:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1395b52398a14f21933e00866ee52ad8',uuid=f700766b-4cb7-4eb9-a0b4-62e2c9c33a77,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converting VIF {"id": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "address": "fa:16:3e:73:43:d1", "network": {"id": "021755a1-86fc-4caa-8c89-ba9a3981f33c", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1598171038-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f06c812f7eb14d6787f160b2c9e0c7f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd6f1e80-dc", "ovs_interfaceid": "dd6f1e80-dce1-4984-9458-d1dd8cd0cab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_vif [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd6f1e80-dc, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dd6840e6-bf77-400d-aed5-275e8158bbcd) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:13 user nova-compute[75307]: INFO os_vif [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:43:d1,bridge_name='br-int',has_traffic_filtering=True,id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2,network=Network(021755a1-86fc-4caa-8c89-ba9a3981f33c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd6f1e80-dc')
Nov 13 23:18:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zeFrUcYt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdn'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:18:13 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffeb635-b90c-43ce-bdc7-4dd05dba818f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:18:13 user nova-compute[75307]: No targets found.
Nov 13 23:18:13 user nova-compute[75307]: iSNS:
Nov 13 23:18:13 user nova-compute[75307]: No targets found.
Nov 13 23:18:13 user nova-compute[75307]: STATIC:
Nov 13 23:18:13 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:18:13 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:18:13 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:18:13 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522
Nov 13 23:18:13 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:18:13 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:18:13 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:18:13 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:18:13 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:18:13 user nova-compute[75307]: FIRMWARE:
Nov 13 23:18:13 user nova-compute[75307]: No targets found.
Nov 13 23:18:13 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:18:13 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:18:13 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ab88b5-39a2-4d52-a6fa-3cbfd42f604e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e894f24-b146-4485-9971-9f2be4e8f80d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:13 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:13 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:18:13 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 (non-flash)
Nov 13 23:18:13 user nova-compute[75307]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:18:13 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:18:13 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34343130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522'): ({'sdn'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Removing single pathed devices sdn {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4098cca-6a34-4a10-875e-6f22ef180306]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdn" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bc6521-b844-4226-88cf-81ecca5d4b17]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Flushing IO for device /dev/sdn {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:18:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdn" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e1b049-9825-458b-87b3-84349994c7ef]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdn/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdn/device/delete" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10e917c-2c2a-403f-8aed-4012563b3aa5]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Checking to see if SCSI volumes sdn have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] SCSI volumes sdn have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a653813e', '/dev/disk/by-id/scsi-26561623862653431', '/dev/disk/by-id/scsi-1SCST_BIOa653813e-eab8be410768be2d') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17e144b-2bc1-4569-bdbd-259a83431aa0]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefafdbf-44fa-4a32-a5cb-ace3246fb8de]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48d1ac3-c174-44c4-991d-550db99cd2c8]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260]
Nov 13 23:18:14 user nova-compute[75307]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522, portal: 172.16.0.220,3260] successful.
Nov 13 23:18:14 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb0cf1e3-92ed-43bd-902d-617253af6522 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a6102f-9ad6-4de4-a129-b19fb663511f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] <== disconnect_volume: return (384ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deleting instance files /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77_del
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deletion of /opt/stack/data/nova/instances/f700766b-4cb7-4eb9-a0b4-62e2c9c33a77_del complete
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.compute.manager [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Took 1.42 seconds to destroy the instance on the hypervisor.
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.compute.claims [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Claim successful on node user
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.compute.claims [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Claim successful on node user
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:18:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:18:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.policy [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0ad50de29ef84625a9b23c295d97484d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec4693b70f449ae8aec526a751ceda8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff49c543-4a95-482c-9cd8-7d61bb2bac5b req-2fc1222c-47d1-47f6-b462-a5eec773a255 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Received event network-vif-deleted-dd6f1e80-dce1-4984-9458-d1dd8cd0cab2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:15 user nova-compute[75307]: INFO nova.compute.manager [req-ff49c543-4a95-482c-9cd8-7d61bb2bac5b req-2fc1222c-47d1-47f6-b462-a5eec773a255 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Neutron deleted interface dd6f1e80-dce1-4984-9458-d1dd8cd0cab2; detaching it from the instance and deleting it from the info cache
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.network.neutron [req-ff49c543-4a95-482c-9cd8-7d61bb2bac5b req-2fc1222c-47d1-47f6-b462-a5eec773a255 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:18:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Creating image(s)
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:15 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Took 0.91 seconds to deallocate network for instance.
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff49c543-4a95-482c-9cd8-7d61bb2bac5b req-2fc1222c-47d1-47f6-b462-a5eec773a255 service nova] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Detach interface failed, port_id=dd6f1e80-dce1-4984-9458-d1dd8cd0cab2, reason: Instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.680s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.222s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk 1073741824" returned: 0 in 0.098s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.policy [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ba43ad1078064bf08022407a4f625e92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f3581a1d5b54b9894827114a10899c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Successfully created port: a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.236s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:18:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:18:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Creating image(s)
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "/opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "/opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Cannot resize image /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Ensure instance console log exists: /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: INFO nova.compute.manager [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Took 1.26 seconds to detach 1 volumes for instance.
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] [instance: f700766b-4cb7-4eb9-a0b4-62e2c9c33a77] Deleting volume: bb0cf1e3-92ed-43bd-902d-617253af6522 {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.237s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk 1073741824" returned: 0 in 0.056s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.200s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Successfully updated port: a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing instance network info cache due to event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Cannot resize image /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Ensure instance console log exists: /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Successfully created port: 5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:18:17 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Deleted allocations for instance f700766b-4cb7-4eb9-a0b4-62e2c9c33a77
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance network_info: |[{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start _get_guest_xml network_info=[{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f12970e1-7d1e-442b-af08-6ea0e6a0c31b tempest-ServerActionsV293TestJSON-1262901442 tempest-ServerActionsV293TestJSON-1262901442-project-member] Lock "f700766b-4cb7-4eb9-a0b4-62e2c9c33a77" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.536s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1092360754',display_name='tempest-ServerStableDeviceRescueTest-server-1092360754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1092360754',id=15,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO1CcKJSxuglMb7gdJ5JBc1gv7mrL0AV9DJCjmp/3v0oY+d9hMUoCvALlkJk0hLvSY8DI1HjcDiIQiUH75CDilOfY7kn9V5A2Irk9in+iVma9dnsMUlICdGug0s/BtaOQ==',key_name='tempest-keypair-315055213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec4693b70f449ae8aec526a751ceda8',ramdisk_id='',reservation_id='r-h936wvew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-236265535',owner_user_name='tempest-ServerStableDeviceRescueTest-236265535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad50de29ef84625a9b23c295d97484d',uuid=c6b7203a-cce3-452a-9002-10011310b3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converting VIF {"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.objects.instance [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'pci_devices' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:17 user nova-compute[75307]:   <uuid>c6b7203a-cce3-452a-9002-10011310b3e2</uuid>
Nov 13 23:18:17 user nova-compute[75307]:   <name>instance-0000000f</name>
Nov 13 23:18:17 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:17 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:17 user nova-compute[75307]:   <metadata>
Nov 13 23:18:17 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:17 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1092360754</nova:name>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:17</nova:creationTime>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:17 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:17 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:user uuid="0ad50de29ef84625a9b23c295d97484d">tempest-ServerStableDeviceRescueTest-236265535-project-member</nova:user>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:project uuid="1ec4693b70f449ae8aec526a751ceda8">tempest-ServerStableDeviceRescueTest-236265535</nova:project>
Nov 13 23:18:17 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:18:17 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:17 user nova-compute[75307]:         <nova:port uuid="a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b">
Nov 13 23:18:17 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:18:17 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:17 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:17 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:17 user nova-compute[75307]:   </metadata>
Nov 13 23:18:17 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:17 user nova-compute[75307]:     <system>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="serial">c6b7203a-cce3-452a-9002-10011310b3e2</entry>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="uuid">c6b7203a-cce3-452a-9002-10011310b3e2</entry>
Nov 13 23:18:17 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:17 user nova-compute[75307]:     </system>
Nov 13 23:18:17 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:17 user nova-compute[75307]:   <os>
Nov 13 23:18:17 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:17 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:18:17 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:17 user nova-compute[75307]:   </os>
Nov 13 23:18:17 user nova-compute[75307]:   <features>
Nov 13 23:18:17 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:17 user nova-compute[75307]:     <apic/>
Nov 13 23:18:17 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:17 user nova-compute[75307]:   </features>
Nov 13 23:18:17 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:17 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:17 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:17 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:17 user nova-compute[75307]:   </clock>
Nov 13 23:18:17 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:17 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:17 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:17 user nova-compute[75307]:   </cpu>
Nov 13 23:18:17 user nova-compute[75307]:   <devices>
Nov 13 23:18:17 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:17 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:17 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk"/>
Nov 13 23:18:17 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:17 user nova-compute[75307]:     </disk>
Nov 13 23:18:17 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:17 user nova-compute[75307]:       <mac address="fa:16:3e:fa:1a:ce"/>
Nov 13 23:18:17 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:17 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:17 user nova-compute[75307]:       <target dev="tapa0a7006d-5f"/>
Nov 13 23:18:17 user nova-compute[75307]:     </interface>
Nov 13 23:18:17 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:17 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/console.log" append="off"/>
Nov 13 23:18:17 user nova-compute[75307]:     </serial>
Nov 13 23:18:17 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:17 user nova-compute[75307]:     <video>
Nov 13 23:18:17 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:17 user nova-compute[75307]:     </video>
Nov 13 23:18:17 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:17 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:17 user nova-compute[75307]:     </rng>
Nov 13 23:18:17 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:17 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:17 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:17 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:17 user nova-compute[75307]:   </devices>
Nov 13 23:18:17 user nova-compute[75307]: </domain>
Nov 13 23:18:17 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1092360754',display_name='tempest-ServerStableDeviceRescueTest-server-1092360754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1092360754',id=15,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO1CcKJSxuglMb7gdJ5JBc1gv7mrL0AV9DJCjmp/3v0oY+d9hMUoCvALlkJk0hLvSY8DI1HjcDiIQiUH75CDilOfY7kn9V5A2Irk9in+iVma9dnsMUlICdGug0s/BtaOQ==',key_name='tempest-keypair-315055213',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1ec4693b70f449ae8aec526a751ceda8',ramdisk_id='',reservation_id='r-h936wvew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-236265535',owner_user_name='tempest-ServerStableDeviceRescueTest-236265535-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad50de29ef84625a9b23c295d97484d',uuid=c6b7203a-cce3-452a-9002-10011310b3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converting VIF {"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG os_vif [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ba531ac-4305-5476-8938-9bf3410ae466', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0a7006d-5f, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0a7006d-5f, col_values=(('qos', UUID('af2e7e20-e271-4753-ae08-4b6fd4b8b3a6')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0a7006d-5f, col_values=(('external_ids', {'iface-id': 'a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fa:1a:ce', 'vm-uuid': 'c6b7203a-cce3-452a-9002-10011310b3e2'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:17 user nova-compute[75307]: INFO os_vif [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f')
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No VIF found with MAC fa:16:3e:fa:1a:ce, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updated VIF entry in instance network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-69c18251-69ae-4ca2-a945-3bce673fdaa9 req-a3b57a00-3227-4148-ad1d-2bd1f4fa07fd service nova] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Successfully updated port: 5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquired lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received event network-changed-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Refreshing instance network info cache due to event network-changed-5d6ee9b0-3165-4d44-b8b8-6da961157b88. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] Acquiring lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updating instance_info_cache with network_info: [{"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Releasing lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Instance network_info: |[{"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] Acquired lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Refreshing network info cache for port 5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Start _get_guest_xml network_info=[{"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6121959',id=16,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXfiVlkfgB25VBiN2JLkY5rjnTwc+Fv9/EWKTG/7Q32FjN9/ncGJJ8wfL7ClCt1JPyMgiX616rd7DMPEHZlkNh/fEoF17IzxQTF8pOeZUCpkr5hbDmXEsH5FJc5foFd/g==',key_name='tempest-keypair-1133104409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3581a1d5b54b9894827114a10899c8',ramdisk_id='',reservation_id='r-lad09l0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba43ad1078064bf08022407a4f625e92',uuid=1c3d5443-61e1-42b7-8c5d-7978dddfb096,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converting VIF {"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:18 user nova-compute[75307]:   <uuid>1c3d5443-61e1-42b7-8c5d-7978dddfb096</uuid>
Nov 13 23:18:18 user nova-compute[75307]:   <name>instance-00000010</name>
Nov 13 23:18:18 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:18 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:18 user nova-compute[75307]:   <metadata>
Nov 13 23:18:18 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:18 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959</nova:name>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:18</nova:creationTime>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:18 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:18 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:user uuid="ba43ad1078064bf08022407a4f625e92">tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member</nova:user>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:project uuid="4f3581a1d5b54b9894827114a10899c8">tempest-TestServerVolumeAttachScenarioOldVersion-150471311</nova:project>
Nov 13 23:18:18 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:18:18 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:18 user nova-compute[75307]:         <nova:port uuid="5d6ee9b0-3165-4d44-b8b8-6da961157b88">
Nov 13 23:18:18 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 23:18:18 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:18 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:18 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:18 user nova-compute[75307]:   </metadata>
Nov 13 23:18:18 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:18 user nova-compute[75307]:     <system>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="serial">1c3d5443-61e1-42b7-8c5d-7978dddfb096</entry>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="uuid">1c3d5443-61e1-42b7-8c5d-7978dddfb096</entry>
Nov 13 23:18:18 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:18 user nova-compute[75307]:     </system>
Nov 13 23:18:18 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:18 user nova-compute[75307]:   <os>
Nov 13 23:18:18 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:18 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:18:18 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:18 user nova-compute[75307]:   </os>
Nov 13 23:18:18 user nova-compute[75307]:   <features>
Nov 13 23:18:18 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:18 user nova-compute[75307]:     <apic/>
Nov 13 23:18:18 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:18 user nova-compute[75307]:   </features>
Nov 13 23:18:18 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:18 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:18 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:18 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:18 user nova-compute[75307]:   </clock>
Nov 13 23:18:18 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:18 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:18 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:18 user nova-compute[75307]:   </cpu>
Nov 13 23:18:18 user nova-compute[75307]:   <devices>
Nov 13 23:18:18 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:18 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:18 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk"/>
Nov 13 23:18:18 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:18 user nova-compute[75307]:     </disk>
Nov 13 23:18:18 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:18 user nova-compute[75307]:       <mac address="fa:16:3e:3f:71:92"/>
Nov 13 23:18:18 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:18 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:18 user nova-compute[75307]:       <target dev="tap5d6ee9b0-31"/>
Nov 13 23:18:18 user nova-compute[75307]:     </interface>
Nov 13 23:18:18 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:18 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/console.log" append="off"/>
Nov 13 23:18:18 user nova-compute[75307]:     </serial>
Nov 13 23:18:18 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:18 user nova-compute[75307]:     <video>
Nov 13 23:18:18 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:18 user nova-compute[75307]:     </video>
Nov 13 23:18:18 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:18 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:18 user nova-compute[75307]:     </rng>
Nov 13 23:18:18 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:18 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:18 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:18 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:18 user nova-compute[75307]:   </devices>
Nov 13 23:18:18 user nova-compute[75307]: </domain>
Nov 13 23:18:18 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6121959',id=16,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXfiVlkfgB25VBiN2JLkY5rjnTwc+Fv9/EWKTG/7Q32FjN9/ncGJJ8wfL7ClCt1JPyMgiX616rd7DMPEHZlkNh/fEoF17IzxQTF8pOeZUCpkr5hbDmXEsH5FJc5foFd/g==',key_name='tempest-keypair-1133104409',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4f3581a1d5b54b9894827114a10899c8',ramdisk_id='',reservation_id='r-lad09l0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba43ad1078064bf08022407a4f625e92',uuid=1c3d5443-61e1-42b7-8c5d-7978dddfb096,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converting VIF {"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG os_vif [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5d8e0ba-2791-5f48-8376-59240f353625', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5d6ee9b0-31, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5d6ee9b0-31, col_values=(('qos', UUID('5cdaa1c7-83b0-4bdb-b938-580bda6ce53e')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5d6ee9b0-31, col_values=(('external_ids', {'iface-id': '5d6ee9b0-3165-4d44-b8b8-6da961157b88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:71:92', 'vm-uuid': '1c3d5443-61e1-42b7-8c5d-7978dddfb096'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:18 user nova-compute[75307]: INFO os_vif [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31')
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] No VIF found with MAC fa:16:3e:3f:71:92, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updated VIF entry in instance network info cache for port 5d6ee9b0-3165-4d44-b8b8-6da961157b88. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updating instance_info_cache with network_info: [{"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d8e6d84a-f421-49fb-a837-dd3884347d84 req-6d507436-dd08-4817-aa57-1f577af87546 service nova] Releasing lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:19 user nova-compute[75307]: WARNING nova.compute.manager [req-dbf85b58-aa8b-4f1a-8046-7bae18c93091 req-35c65ffe-439d-43fa-a62f-602b7b9248e3 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state building and task_state spawning.
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:21 user nova-compute[75307]: WARNING nova.compute.manager [req-eaa46967-ce31-4b2c-bfff-fb99121c572d req-3ab8f59d-0fa6-4b5b-970e-f742b5f6d433 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state building and task_state spawning.
Nov 13 23:18:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance spawned successfully.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Took 7.98 seconds to spawn the instance on the hypervisor.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.compute.manager [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Took 9.00 seconds to build instance.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Instance spawned successfully.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725b1c42-b686-4005-821b-b9c0071acc65 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.179s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Took 7.35 seconds to spawn the instance on the hypervisor.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:23 user nova-compute[75307]: INFO nova.compute.manager [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Took 8.66 seconds to build instance.
Nov 13 23:18:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f2fdca45-7c37-4b14-ac95-b905f3c8c86a tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.829s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received event network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] No waiting events found dispatching network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:27 user nova-compute[75307]: WARNING nova.compute.manager [req-91a27f05-8341-447d-b5e3-ea08cff63aee req-c74390c0-abc5-409d-befe-146cf8929c5b service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received unexpected event network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 for instance with vm_state active and task_state None.
Nov 13 23:18:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:18:29 user nova-compute[75307]: INFO nova.compute.claims [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Claim successful on node user
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received event network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] No waiting events found dispatching network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:29 user nova-compute[75307]: WARNING nova.compute.manager [req-9a01a43f-9d48-4f47-8f07-24acd79b632e req-4b4da1de-3dde-46c2-a051-bdee47bd15be service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received unexpected event network-vif-plugged-5d6ee9b0-3165-4d44-b8b8-6da961157b88 for instance with vm_state active and task_state None.
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:18:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:18:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Creating image(s)
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "/opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "/opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "/opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.084s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.policy [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56e0ac93206e4f3497436adad95919ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ce44d5d8bb48d5a53bdd99da3cd17b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.211s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.222s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk 1073741824" returned: 0 in 0.051s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.212s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Cannot resize image /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Ensure instance console log exists: /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Successfully created port: b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Successfully updated port: b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquired lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-changed-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Refreshing instance network info cache due to event network-changed-b8af2747-4849-4506-8dba-1f948bc07137. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] Acquiring lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:18:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updating instance_info_cache with network_info: [{"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Releasing lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Instance network_info: |[{"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] Acquired lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Refreshing network info cache for port b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Start _get_guest_xml network_info=[{"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2016176540',display_name='tempest-TestVolumeSwap-server-2016176540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2016176540',id=17,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwtbX7B8oozunNJs9j7wOj6qm93UWthDgZe08lpeUdaz/tTVlactjVE6t2YSCcLvTTBnTnMhPlTGyHnI4KUzFGm57bcdfdPp7UJZV+dAL76eDg3v6YJwwXafv8N0tx/jQ==',key_name='tempest-keypair-1111887680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ce44d5d8bb48d5a53bdd99da3cd17b',ramdisk_id='',reservation_id='r-3yo0t0o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-292329471',owner_user_name='tempest-TestVolumeSwap-292329471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0ac93206e4f3497436adad95919ff',uuid=d2b088e1-c3d9-4f82-86ef-a24cdaecff1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converting VIF {"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lazy-loading 'pci_devices' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:32 user nova-compute[75307]:   <uuid>d2b088e1-c3d9-4f82-86ef-a24cdaecff1c</uuid>
Nov 13 23:18:32 user nova-compute[75307]:   <name>instance-00000011</name>
Nov 13 23:18:32 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:32 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:32 user nova-compute[75307]:   <metadata>
Nov 13 23:18:32 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:32 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:name>tempest-TestVolumeSwap-server-2016176540</nova:name>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:32</nova:creationTime>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:32 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:32 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:user uuid="56e0ac93206e4f3497436adad95919ff">tempest-TestVolumeSwap-292329471-project-member</nova:user>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:project uuid="62ce44d5d8bb48d5a53bdd99da3cd17b">tempest-TestVolumeSwap-292329471</nova:project>
Nov 13 23:18:32 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:18:32 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:32 user nova-compute[75307]:         <nova:port uuid="b8af2747-4849-4506-8dba-1f948bc07137">
Nov 13 23:18:32 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:18:32 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:32 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:32 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:32 user nova-compute[75307]:   </metadata>
Nov 13 23:18:32 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:32 user nova-compute[75307]:     <system>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="serial">d2b088e1-c3d9-4f82-86ef-a24cdaecff1c</entry>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="uuid">d2b088e1-c3d9-4f82-86ef-a24cdaecff1c</entry>
Nov 13 23:18:32 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:32 user nova-compute[75307]:     </system>
Nov 13 23:18:32 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:32 user nova-compute[75307]:   <os>
Nov 13 23:18:32 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:32 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:18:32 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:32 user nova-compute[75307]:   </os>
Nov 13 23:18:32 user nova-compute[75307]:   <features>
Nov 13 23:18:32 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:32 user nova-compute[75307]:     <apic/>
Nov 13 23:18:32 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:32 user nova-compute[75307]:   </features>
Nov 13 23:18:32 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:32 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:32 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:32 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:32 user nova-compute[75307]:   </clock>
Nov 13 23:18:32 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:32 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:32 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:32 user nova-compute[75307]:   </cpu>
Nov 13 23:18:32 user nova-compute[75307]:   <devices>
Nov 13 23:18:32 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:32 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:32 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk"/>
Nov 13 23:18:32 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:32 user nova-compute[75307]:     </disk>
Nov 13 23:18:32 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:32 user nova-compute[75307]:       <mac address="fa:16:3e:d9:10:e0"/>
Nov 13 23:18:32 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:32 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:32 user nova-compute[75307]:       <target dev="tapb8af2747-48"/>
Nov 13 23:18:32 user nova-compute[75307]:     </interface>
Nov 13 23:18:32 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:32 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/console.log" append="off"/>
Nov 13 23:18:32 user nova-compute[75307]:     </serial>
Nov 13 23:18:32 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:32 user nova-compute[75307]:     <video>
Nov 13 23:18:32 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:32 user nova-compute[75307]:     </video>
Nov 13 23:18:32 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:32 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:32 user nova-compute[75307]:     </rng>
Nov 13 23:18:32 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:32 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:32 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:32 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:32 user nova-compute[75307]:   </devices>
Nov 13 23:18:32 user nova-compute[75307]: </domain>
Nov 13 23:18:32 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2016176540',display_name='tempest-TestVolumeSwap-server-2016176540',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2016176540',id=17,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwtbX7B8oozunNJs9j7wOj6qm93UWthDgZe08lpeUdaz/tTVlactjVE6t2YSCcLvTTBnTnMhPlTGyHnI4KUzFGm57bcdfdPp7UJZV+dAL76eDg3v6YJwwXafv8N0tx/jQ==',key_name='tempest-keypair-1111887680',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62ce44d5d8bb48d5a53bdd99da3cd17b',ramdisk_id='',reservation_id='r-3yo0t0o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-292329471',owner_user_name='tempest-TestVolumeSwap-292329471-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:18:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0ac93206e4f3497436adad95919ff',uuid=d2b088e1-c3d9-4f82-86ef-a24cdaecff1c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converting VIF {"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG os_vif [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80483623-d7e6-54e8-b711-b93af10cbbeb', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8af2747-48, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8af2747-48, col_values=(('qos', UUID('4564e21f-088f-49b4-9820-71ad55dfc1d8')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8af2747-48, col_values=(('external_ids', {'iface-id': 'b8af2747-4849-4506-8dba-1f948bc07137', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:10:e0', 'vm-uuid': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:32 user nova-compute[75307]: INFO os_vif [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48')
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] No VIF found with MAC fa:16:3e:d9:10:e0, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updated VIF entry in instance network info cache for port b8af2747-4849-4506-8dba-1f948bc07137. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updating instance_info_cache with network_info: [{"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-edd95b8d-7672-4572-b049-68283d68e010 req-7f546a57-306f-4afe-813f-15194935ed6c service nova] Releasing lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] No waiting events found dispatching network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:34 user nova-compute[75307]: WARNING nova.compute.manager [req-e1b0182f-8216-4008-beac-e9834a0e208f req-ea38329f-83e8-4d05-b9cb-b35c3638fb9b service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received unexpected event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 for instance with vm_state building and task_state spawning.
Nov 13 23:18:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:18:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Instance spawned successfully.
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] No waiting events found dispatching network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:36 user nova-compute[75307]: WARNING nova.compute.manager [req-ac103bde-7a98-45b4-aaf8-4343a4d2505b req-5123b01f-c7ef-48d2-be8f-e6f9fa9e7fef service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received unexpected event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 for instance with vm_state building and task_state spawning.
Nov 13 23:18:36 user nova-compute[75307]: INFO nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Took 6.44 seconds to spawn the instance on the hypervisor.
Nov 13 23:18:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:36 user nova-compute[75307]: INFO nova.compute.manager [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Took 7.40 seconds to build instance.
Nov 13 23:18:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80b45b94-98de-4f49-b2e7-36b0bb45e605 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.537s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:48 user nova-compute[75307]: INFO nova.compute.manager [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Rescuing
Nov 13 23:18:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:18:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:18:48 user nova-compute[75307]: DEBUG nova.network.neutron [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:49 user nova-compute[75307]: WARNING nova.compute.manager [req-c7e83ba0-e32b-4f24-806a-a7dd076cd9b3 req-706e9133-b341-493f-9ede-21c5d31ae9a4 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state rescuing.
Nov 13 23:18:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance destroyed successfully.
Nov 13 23:18:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Attempting rescue
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:18:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Creating image(s)
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:49 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'trusted_certs' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue" returned: 0 in 0.064s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'migration_context' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.base [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<11cd5b9d-7bb2-4492-8031-a9676c288140> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start _get_guest_xml network_info=[{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:a9:6b:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.base [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<11cd5b9d-7bb2-4492-8031-a9676c288140> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'numa_topology' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.base [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<11cd5b9d-7bb2-4492-8031-a9676c288140> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'vcpu_model' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.base [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<11cd5b9d-7bb2-4492-8031-a9676c288140> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658784171',display_name='tempest-ServerRescueNegativeTestJSON-server-1658784171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658784171',id=2,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-d1rywi5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:14:23Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=11cd5b9d-7bb2-4492-8031-a9676c288140,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:a9:6b:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:a9:6b:e6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.objects.base [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<11cd5b9d-7bb2-4492-8031-a9676c288140> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:18:50 user nova-compute[75307]:   <uuid>11cd5b9d-7bb2-4492-8031-a9676c288140</uuid>
Nov 13 23:18:50 user nova-compute[75307]:   <name>instance-00000002</name>
Nov 13 23:18:50 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:18:50 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:18:50 user nova-compute[75307]:   <metadata>
Nov 13 23:18:50 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:18:50 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1658784171</nova:name>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:18:50</nova:creationTime>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:18:50 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:18:50 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:owner>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:18:50 user nova-compute[75307]:       </nova:owner>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:18:50 user nova-compute[75307]:       <nova:ports>
Nov 13 23:18:50 user nova-compute[75307]:         <nova:port uuid="92e3832b-fb83-4ed1-8a9a-bc575a008b87">
Nov 13 23:18:50 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:18:50 user nova-compute[75307]:         </nova:port>
Nov 13 23:18:50 user nova-compute[75307]:       </nova:ports>
Nov 13 23:18:50 user nova-compute[75307]:     </nova:instance>
Nov 13 23:18:50 user nova-compute[75307]:   </metadata>
Nov 13 23:18:50 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:18:50 user nova-compute[75307]:     <system>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="serial">11cd5b9d-7bb2-4492-8031-a9676c288140</entry>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="uuid">11cd5b9d-7bb2-4492-8031-a9676c288140</entry>
Nov 13 23:18:50 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:18:50 user nova-compute[75307]:     </system>
Nov 13 23:18:50 user nova-compute[75307]:   </sysinfo>
Nov 13 23:18:50 user nova-compute[75307]:   <os>
Nov 13 23:18:50 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:18:50 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:18:50 user nova-compute[75307]:   </os>
Nov 13 23:18:50 user nova-compute[75307]:   <features>
Nov 13 23:18:50 user nova-compute[75307]:     <acpi/>
Nov 13 23:18:50 user nova-compute[75307]:     <apic/>
Nov 13 23:18:50 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:18:50 user nova-compute[75307]:   </features>
Nov 13 23:18:50 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:18:50 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:18:50 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:18:50 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:18:50 user nova-compute[75307]:   </clock>
Nov 13 23:18:50 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:18:50 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:18:50 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:18:50 user nova-compute[75307]:   </cpu>
Nov 13 23:18:50 user nova-compute[75307]:   <devices>
Nov 13 23:18:50 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:50 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:50 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue"/>
Nov 13 23:18:50 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:18:50 user nova-compute[75307]:     </disk>
Nov 13 23:18:50 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:18:50 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:18:50 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk"/>
Nov 13 23:18:50 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:18:50 user nova-compute[75307]:     </disk>
Nov 13 23:18:50 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:18:50 user nova-compute[75307]:       <mac address="fa:16:3e:a9:6b:e6"/>
Nov 13 23:18:50 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:50 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:18:50 user nova-compute[75307]:       <target dev="tap92e3832b-fb"/>
Nov 13 23:18:50 user nova-compute[75307]:     </interface>
Nov 13 23:18:50 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:18:50 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/console.log" append="off"/>
Nov 13 23:18:50 user nova-compute[75307]:     </serial>
Nov 13 23:18:50 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:18:50 user nova-compute[75307]:     <video>
Nov 13 23:18:50 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:18:50 user nova-compute[75307]:     </video>
Nov 13 23:18:50 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:18:50 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:18:50 user nova-compute[75307]:     </rng>
Nov 13 23:18:50 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:18:50 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:18:50 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:18:50 user nova-compute[75307]:     </memballoon>
Nov 13 23:18:50 user nova-compute[75307]:   </devices>
Nov 13 23:18:50 user nova-compute[75307]: </domain>
Nov 13 23:18:50 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:18:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance destroyed successfully.
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:18:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:a9:6b:e6, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:51 user nova-compute[75307]: WARNING nova.compute.manager [req-465c2cf3-4fbf-436d-9417-20c3b708c307 req-c870091e-1846-4547-a46d-51a2a9b5faec service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state rescuing.
Nov 13 23:18:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:53 user nova-compute[75307]: WARNING nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state rescuing.
Nov 13 23:18:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:18:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:18:53 user nova-compute[75307]: WARNING nova.compute.manager [req-ff744816-1da9-48d4-ad5f-68bc593ebb2f req-d3d30a57-86ae-41af-9a86-9b4e19b301aa service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state rescuing.
Nov 13 23:18:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-a9873915-c58c-4096-aabd-7d65696345f2 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:18:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:18:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:19:00 user nova-compute[75307]: INFO nova.compute.claims [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Claim successful on node user
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:19:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.policy [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b605f62d134435896eb5dce0b48d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4260b68885d4f5ebfa01306bf64a9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:19:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Creating image(s)
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "/opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk 1073741824" returned: 0 in 0.067s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Successfully created port: 872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Cannot resize image /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Ensure instance console log exists: /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Successfully updated port: 872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-changed-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing instance network info cache due to event network-changed-872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Instance network_info: |[{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing network info cache for port 872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Start _get_guest_xml network_info=[{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:19:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-56780046',display_name='tempest-ServerActionsTestOtherA-server-56780046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-56780046',id=18,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-17hxeb27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=8bf8a928-35cc-413a-b7e8-5afeecb20924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'pci_devices' on Instance uuid 8bf8a928-35cc-413a-b7e8-5afeecb20924 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:19:03 user nova-compute[75307]:   <uuid>8bf8a928-35cc-413a-b7e8-5afeecb20924</uuid>
Nov 13 23:19:03 user nova-compute[75307]:   <name>instance-00000012</name>
Nov 13 23:19:03 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:19:03 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:19:03 user nova-compute[75307]:   <metadata>
Nov 13 23:19:03 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:19:03 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherA-server-56780046</nova:name>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:19:03</nova:creationTime>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:19:03 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:19:03 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:owner>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:user uuid="7b605f62d134435896eb5dce0b48d51c">tempest-ServerActionsTestOtherA-708902499-project-member</nova:user>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:project uuid="f4260b68885d4f5ebfa01306bf64a9b9">tempest-ServerActionsTestOtherA-708902499</nova:project>
Nov 13 23:19:03 user nova-compute[75307]:       </nova:owner>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:19:03 user nova-compute[75307]:       <nova:ports>
Nov 13 23:19:03 user nova-compute[75307]:         <nova:port uuid="872b038e-7eab-4644-bf2b-11a948011758">
Nov 13 23:19:03 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 23:19:03 user nova-compute[75307]:         </nova:port>
Nov 13 23:19:03 user nova-compute[75307]:       </nova:ports>
Nov 13 23:19:03 user nova-compute[75307]:     </nova:instance>
Nov 13 23:19:03 user nova-compute[75307]:   </metadata>
Nov 13 23:19:03 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:19:03 user nova-compute[75307]:     <system>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="serial">8bf8a928-35cc-413a-b7e8-5afeecb20924</entry>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="uuid">8bf8a928-35cc-413a-b7e8-5afeecb20924</entry>
Nov 13 23:19:03 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:19:03 user nova-compute[75307]:     </system>
Nov 13 23:19:03 user nova-compute[75307]:   </sysinfo>
Nov 13 23:19:03 user nova-compute[75307]:   <os>
Nov 13 23:19:03 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:19:03 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:19:03 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:19:03 user nova-compute[75307]:   </os>
Nov 13 23:19:03 user nova-compute[75307]:   <features>
Nov 13 23:19:03 user nova-compute[75307]:     <acpi/>
Nov 13 23:19:03 user nova-compute[75307]:     <apic/>
Nov 13 23:19:03 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:19:03 user nova-compute[75307]:   </features>
Nov 13 23:19:03 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:19:03 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:19:03 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:19:03 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:19:03 user nova-compute[75307]:   </clock>
Nov 13 23:19:03 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:19:03 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:19:03 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:19:03 user nova-compute[75307]:   </cpu>
Nov 13 23:19:03 user nova-compute[75307]:   <devices>
Nov 13 23:19:03 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:19:03 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:19:03 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk"/>
Nov 13 23:19:03 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:19:03 user nova-compute[75307]:     </disk>
Nov 13 23:19:03 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:19:03 user nova-compute[75307]:       <mac address="fa:16:3e:cc:6b:e9"/>
Nov 13 23:19:03 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:19:03 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:19:03 user nova-compute[75307]:       <target dev="tap872b038e-7e"/>
Nov 13 23:19:03 user nova-compute[75307]:     </interface>
Nov 13 23:19:03 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:19:03 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/console.log" append="off"/>
Nov 13 23:19:03 user nova-compute[75307]:     </serial>
Nov 13 23:19:03 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:19:03 user nova-compute[75307]:     <video>
Nov 13 23:19:03 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:19:03 user nova-compute[75307]:     </video>
Nov 13 23:19:03 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:19:03 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:19:03 user nova-compute[75307]:     </rng>
Nov 13 23:19:03 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:19:03 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:19:03 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:19:03 user nova-compute[75307]:     </memballoon>
Nov 13 23:19:03 user nova-compute[75307]:   </devices>
Nov 13 23:19:03 user nova-compute[75307]: </domain>
Nov 13 23:19:03 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-56780046',display_name='tempest-ServerActionsTestOtherA-server-56780046',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-56780046',id=18,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-17hxeb27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=8bf8a928-35cc-413a-b7e8-5afeecb20924,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG os_vif [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ffe375-2e63-503a-99ee-5f0fa955e6f6', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap872b038e-7e, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap872b038e-7e, col_values=(('qos', UUID('ed9e6bc2-2352-4b05-87e9-a3bf329c1172')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap872b038e-7e, col_values=(('external_ids', {'iface-id': '872b038e-7eab-4644-bf2b-11a948011758', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:6b:e9', 'vm-uuid': '8bf8a928-35cc-413a-b7e8-5afeecb20924'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:03 user nova-compute[75307]: INFO os_vif [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e')
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:cc:6b:e9, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated VIF entry in instance network info cache for port 872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a9b3f4b-0e6f-4b03-8428-5d5fc90ee16a req-ef6ef773-f0b1-4829-ae7a-824b11ad9bcb service nova] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] No waiting events found dispatching network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:04 user nova-compute[75307]: WARNING nova.compute.manager [req-e138f9fc-b8eb-49e8-9f96-be4c81948c27 req-979be70b-c126-463b-b9e1-c8c88bf3101c service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received unexpected event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 for instance with vm_state building and task_state spawning.
Nov 13 23:19:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] No waiting events found dispatching network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:06 user nova-compute[75307]: WARNING nova.compute.manager [req-814222e7-c91b-4711-b611-071931f2f611 req-013db186-d40b-4589-9556-921fd3853a91 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received unexpected event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 for instance with vm_state building and task_state spawning.
Nov 13 23:19:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:19:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Instance spawned successfully.
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:07 user nova-compute[75307]: INFO nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 13 23:19:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:19:07 user nova-compute[75307]: INFO nova.compute.manager [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Took 6.71 seconds to build instance.
Nov 13 23:19:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f115501c-cf97-4304-acea-c2ff99bb827d tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.824s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating instance_info_cache with network_info: [{"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-ea05ed6f-d9fa-4393-beb6-569f50defea6" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:19:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:14 user nova-compute[75307]: INFO nova.compute.manager [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Terminating instance
Nov 13 23:19:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-b711b4cd-1b7f-4156-aeec-97bfe0011280 req-a6281386-c28b-4c2e-ba6e-1547f5b19161 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Instance destroyed successfully.
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'resources' on Instance uuid 245c74b2-6792-4e9f-8bbe-4426e4b32df8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1585767879',display_name='tempest-VolumesAdminNegativeTest-server-1585767879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1585767879',id=13,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:17:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-0yrnxj3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:17:26Z,user_data=None,user_id='6962721fd5104239bdd55f20fd7dc702',uuid=245c74b2-6792-4e9f-8bbe-4426e4b32df8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "1235dc02-43da-4806-84e2-16d065cfdcb2", "address": "fa:16:3e:bb:83:11", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1235dc02-43", "ovs_interfaceid": "1235dc02-43da-4806-84e2-16d065cfdcb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG os_vif [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1235dc02-43, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf2d1faa-eb6e-4c99-9bd0-e50d028c101c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:19:15 user nova-compute[75307]: INFO os_vif [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:83:11,bridge_name='br-int',has_traffic_filtering=True,id=1235dc02-43da-4806-84e2-16d065cfdcb2,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1235dc02-43')
Nov 13 23:19:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Deleting instance files /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8_del
Nov 13 23:19:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Deletion of /opt/stack/data/nova/instances/245c74b2-6792-4e9f-8bbe-4426e4b32df8_del complete
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json" returned: 0 in 0.260s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:15 user nova-compute[75307]: INFO nova.compute.manager [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:16 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Took 0.91 seconds to deallocate network for instance.
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:16 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Error from libvirt while getting description of instance-0000000d: [Error Code 42] Domain not found: no domain with matching uuid '245c74b2-6792-4e9f-8bbe-4426e4b32df8' (instance-0000000d): libvirt.libvirtError: Domain not found: no domain with matching uuid '245c74b2-6792-4e9f-8bbe-4426e4b32df8' (instance-0000000d)
Nov 13 23:19:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:19:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:17 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Deleted allocations for instance 245c74b2-6792-4e9f-8bbe-4426e4b32df8
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:17 user nova-compute[75307]: WARNING nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state deleted and task_state None.
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:17 user nova-compute[75307]: WARNING nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state deleted and task_state None.
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:17 user nova-compute[75307]: WARNING nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state deleted and task_state None.
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:17 user nova-compute[75307]: WARNING nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-unplugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state deleted and task_state None.
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-deleted-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Acquiring lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] No waiting events found dispatching network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:17 user nova-compute[75307]: WARNING nova.compute.manager [req-5e043236-7f6a-481f-bf49-88942112eeda req-a4f47ddd-6fed-4379-8afd-fb4c3d0fd008 service nova] [instance: 245c74b2-6792-4e9f-8bbe-4426e4b32df8] Received unexpected event network-vif-plugged-1235dc02-43da-4806-84e2-16d065cfdcb2 for instance with vm_state deleted and task_state None.
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c8791c68-ca36-472d-8372-27e8144b9337 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "245c74b2-6792-4e9f-8bbe-4426e4b32df8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.607s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7318MB free_disk=25.492000579833984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:19:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.484s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:19:41 user nova-compute[75307]: INFO nova.compute.claims [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Claim successful on node user
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:19:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:19:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:19:42 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Creating image(s)
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "/opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "/opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.043s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.policy [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ea16a187d0247899a6b066823fd098f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aec709d149343f9a943ff116110c623', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk 1073741824" returned: 0 in 0.052s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Cannot resize image /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Ensure instance console log exists: /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Successfully created port: 87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Successfully updated port: 87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquired lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-changed-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Refreshing instance network info cache due to event network-changed-87cab48e-d481-4b82-a522-805bffe25bd2. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] Acquiring lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Updating instance_info_cache with network_info: [{"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Releasing lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Instance network_info: |[{"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] Acquired lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.neutron [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Refreshing network info cache for port 87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Start _get_guest_xml network_info=[{"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:19:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-398823675',display_name='tempest-VolumesNegativeTest-instance-398823675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-398823675',id=19,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aec709d149343f9a943ff116110c623',ramdisk_id='',reservation_id='r-53pg1574',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-308397641',owner_user_name='tempest-VolumesNegativeTest-308397641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:42Z,user_data=None,user_id='9ea16a187d0247899a6b066823fd098f',uuid=e6c464b7-a6ae-4f78-9159-5643d52c2295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converting VIF {"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lazy-loading 'pci_devices' on Instance uuid e6c464b7-a6ae-4f78-9159-5643d52c2295 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:19:44 user nova-compute[75307]:   <uuid>e6c464b7-a6ae-4f78-9159-5643d52c2295</uuid>
Nov 13 23:19:44 user nova-compute[75307]:   <name>instance-00000013</name>
Nov 13 23:19:44 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:19:44 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:19:44 user nova-compute[75307]:   <metadata>
Nov 13 23:19:44 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:19:44 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:name>tempest-VolumesNegativeTest-instance-398823675</nova:name>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:19:44</nova:creationTime>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:19:44 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:19:44 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:owner>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:user uuid="9ea16a187d0247899a6b066823fd098f">tempest-VolumesNegativeTest-308397641-project-member</nova:user>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:project uuid="7aec709d149343f9a943ff116110c623">tempest-VolumesNegativeTest-308397641</nova:project>
Nov 13 23:19:44 user nova-compute[75307]:       </nova:owner>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:19:44 user nova-compute[75307]:       <nova:ports>
Nov 13 23:19:44 user nova-compute[75307]:         <nova:port uuid="87cab48e-d481-4b82-a522-805bffe25bd2">
Nov 13 23:19:44 user nova-compute[75307]:           <nova:ip type="fixed" address="192.168.233.45" ipVersion="4"/>
Nov 13 23:19:44 user nova-compute[75307]:         </nova:port>
Nov 13 23:19:44 user nova-compute[75307]:       </nova:ports>
Nov 13 23:19:44 user nova-compute[75307]:     </nova:instance>
Nov 13 23:19:44 user nova-compute[75307]:   </metadata>
Nov 13 23:19:44 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:19:44 user nova-compute[75307]:     <system>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="serial">e6c464b7-a6ae-4f78-9159-5643d52c2295</entry>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="uuid">e6c464b7-a6ae-4f78-9159-5643d52c2295</entry>
Nov 13 23:19:44 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:19:44 user nova-compute[75307]:     </system>
Nov 13 23:19:44 user nova-compute[75307]:   </sysinfo>
Nov 13 23:19:44 user nova-compute[75307]:   <os>
Nov 13 23:19:44 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:19:44 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:19:44 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:19:44 user nova-compute[75307]:   </os>
Nov 13 23:19:44 user nova-compute[75307]:   <features>
Nov 13 23:19:44 user nova-compute[75307]:     <acpi/>
Nov 13 23:19:44 user nova-compute[75307]:     <apic/>
Nov 13 23:19:44 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:19:44 user nova-compute[75307]:   </features>
Nov 13 23:19:44 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:19:44 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:19:44 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:19:44 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:19:44 user nova-compute[75307]:   </clock>
Nov 13 23:19:44 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:19:44 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:19:44 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:19:44 user nova-compute[75307]:   </cpu>
Nov 13 23:19:44 user nova-compute[75307]:   <devices>
Nov 13 23:19:44 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:19:44 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:19:44 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk"/>
Nov 13 23:19:44 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:19:44 user nova-compute[75307]:     </disk>
Nov 13 23:19:44 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:19:44 user nova-compute[75307]:       <mac address="fa:16:3e:54:10:50"/>
Nov 13 23:19:44 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:19:44 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:19:44 user nova-compute[75307]:       <target dev="tap87cab48e-d4"/>
Nov 13 23:19:44 user nova-compute[75307]:     </interface>
Nov 13 23:19:44 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:19:44 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/console.log" append="off"/>
Nov 13 23:19:44 user nova-compute[75307]:     </serial>
Nov 13 23:19:44 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:19:44 user nova-compute[75307]:     <video>
Nov 13 23:19:44 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:19:44 user nova-compute[75307]:     </video>
Nov 13 23:19:44 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:19:44 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:19:44 user nova-compute[75307]:     </rng>
Nov 13 23:19:44 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:19:44 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:19:44 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:19:44 user nova-compute[75307]:     </memballoon>
Nov 13 23:19:44 user nova-compute[75307]:   </devices>
Nov 13 23:19:44 user nova-compute[75307]: </domain>
Nov 13 23:19:44 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-398823675',display_name='tempest-VolumesNegativeTest-instance-398823675',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-398823675',id=19,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aec709d149343f9a943ff116110c623',ramdisk_id='',reservation_id='r-53pg1574',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-308397641',owner_user_name='tempest-VolumesNegativeTest-308397641-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:42Z,user_data=None,user_id='9ea16a187d0247899a6b066823fd098f',uuid=e6c464b7-a6ae-4f78-9159-5643d52c2295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converting VIF {"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG os_vif [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d659379-a46a-5fa2-a978-d56f12d1db2b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87cab48e-d4, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87cab48e-d4, col_values=(('qos', UUID('2aa0e725-e77b-4bc4-b2c9-ecb44ca0276d')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87cab48e-d4, col_values=(('external_ids', {'iface-id': '87cab48e-d481-4b82-a522-805bffe25bd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:10:50', 'vm-uuid': 'e6c464b7-a6ae-4f78-9159-5643d52c2295'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:44 user nova-compute[75307]: INFO os_vif [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4')
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] No VIF found with MAC fa:16:3e:54:10:50, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.neutron [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Updated VIF entry in instance network info cache for port 87cab48e-d481-4b82-a522-805bffe25bd2. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG nova.network.neutron [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Updating instance_info_cache with network_info: [{"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4101fa8d-4fdc-4d6a-b78b-2dd4a161fa04 req-03b09a45-5737-4313-901d-546bc0cc0a98 service nova] Releasing lock "refresh_cache-e6c464b7-a6ae-4f78-9159-5643d52c2295" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] No waiting events found dispatching network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:45 user nova-compute[75307]: WARNING nova.compute.manager [req-943a42df-ec04-4375-9a62-9c2473ccf5d0 req-b9eb4260-3b74-460d-8f45-091cdc573611 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received unexpected event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 for instance with vm_state building and task_state spawning.
Nov 13 23:19:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:19:47 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Instance spawned successfully.
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:19:47 user nova-compute[75307]: INFO nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Took 5.75 seconds to spawn the instance on the hypervisor.
Nov 13 23:19:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:19:47 user nova-compute[75307]: INFO nova.compute.manager [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Took 6.50 seconds to build instance.
Nov 13 23:19:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c354358b-505c-441d-8555-d149d72c3e7a tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.584s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] No waiting events found dispatching network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:19:48 user nova-compute[75307]: WARNING nova.compute.manager [req-f5704577-ec82-4b95-b875-b994b9ff4d41 req-2823e316-6318-45e0-b277-d3d4307f6bf7 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received unexpected event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 for instance with vm_state active and task_state None.
Nov 13 23:19:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-changed-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Refreshing instance network info cache due to event network-changed-da729a35-f81c-4005-a179-a06292942c86. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] Acquiring lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] Acquired lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Refreshing network info cache for port da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updated VIF entry in instance network info cache for port da729a35-f81c-4005-a179-a06292942c86. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updating instance_info_cache with network_info: [{"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23c27a81-472a-42be-bffa-437d45828b20 req-45170960-d139-489a-83ab-71ab609651bd service nova] Releasing lock "refresh_cache-d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:50 user nova-compute[75307]: INFO nova.compute.manager [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Detaching volume 2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:19:50 user nova-compute[75307]: INFO nova.virt.block_device [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Attempting to driver detach volume 2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 from mountpoint /dev/vdb
Nov 13 23:19:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Attempting to detach device vdb from instance fdc18eac-a300-4f89-8621-2075decfec01 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:19:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:19:50 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:19:50 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:19:50 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:19:50 user nova-compute[75307]:   <serial>2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3</serial>
Nov 13 23:19:50 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:19:50 user nova-compute[75307]: </disk>
Nov 13 23:19:50 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:19:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdb from instance fdc18eac-a300-4f89-8621-2075decfec01 from the persistent domain config.
Nov 13 23:19:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdc18eac-a300-4f89-8621-2075decfec01 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:19:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:19:50 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:19:50 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:19:50 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:19:50 user nova-compute[75307]:   <serial>2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3</serial>
Nov 13 23:19:50 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:19:50 user nova-compute[75307]: </disk>
Nov 13 23:19:50 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:19:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:19:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:19:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:19:55 user nova-compute[75307]: INFO nova.compute.claims [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Claim successful on node user
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:19:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.484s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:19:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:19:56 user nova-compute[75307]: INFO nova.virt.block_device [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Booting with volume snapshot c2129da3-a2ba-4cea-9ec4-22760c779bb5 at /dev/vda
Nov 13 23:19:56 user nova-compute[75307]: DEBUG nova.policy [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:19:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:57 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Successfully created port: 986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Successfully updated port: 986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-changed-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Refreshing instance network info cache due to event network-changed-986fd54a-b4ec-4e9f-ae09-25dc147be28c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] Acquiring lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:19:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updating instance_info_cache with network_info: [{"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Instance network_info: |[{"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] Acquired lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Refreshing network info cache for port 986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updated VIF entry in instance network info cache for port 986fd54a-b4ec-4e9f-ae09-25dc147be28c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updating instance_info_cache with network_info: [{"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:19:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f3970d66-c1bc-4392-a8ce-5be70f74067e req-044f570f-91da-4593-b43c-8330f55935c3 service nova] Releasing lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:20:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:20:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.utils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd4e81b-c5c5-41d9-a31d-87b637ffcf3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc07998f-0d61-474f-bf51-47f5dd48ccdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d72eda-3a92-4174-9a5b-cb8f88bcf3a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b71e0da-5ed6-46d8-9451-110dc87f8c47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:02 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21e862-b63a-4093-b836-618529be14ee]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG os_brick.utils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updating existing volume attachment record: 71453a53-0534-47d9-bfb5-e01f09bd9c90 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:02 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:20:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:20:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing instance network info cache due to event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.network.neutron [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received event network-changed-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Refreshing instance network info cache due to event network-changed-5d6ee9b0-3165-4d44-b8b8-6da961157b88. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] Acquiring lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] Acquired lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:05 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Refreshing network info cache for port 5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updated VIF entry in instance network info cache for port 5d6ee9b0-3165-4d44-b8b8-6da961157b88. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updating instance_info_cache with network_info: [{"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5a7b6227-c508-4676-baf7-48eb09e6132f req-7f11e9f7-3b63-4b21-bfa4-5aad65529443 service nova] Releasing lock "refresh_cache-1c3d5443-61e1-42b7-8c5d-7978dddfb096" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updated VIF entry in instance network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-073f766a-0785-4280-b981-4d9c17f1b2fe req-098c64e8-647f-4b04-9ada-37f6d49a705e service nova] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:20:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:20:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Creating image(s)
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Ensure instance console log exists: /opt/stack/data/nova/instances/e7eb8413-a53f-45bd-9043-54f23c1c1e10/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Start _get_guest_xml network_info=[{"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T23:19:51Z,direct_url=<?>,disk_format='qcow2',id=51259063-ea79-45f7-9ef9-eea57202ada9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-908575476',owner='2f7dd660313a41b9a468835b35ceca8b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T23:19:52Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLwmXNDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e7eb8413-a53f-45bd-9043-54f23c1c1e10', 'attached_at': '', 'detached_at': '', 'volume_id': '094fc17c-acc8-4649-a44b-5931f08dc4b8', 'serial': '094fc17c-acc8-4649-a44b-5931f08dc4b8'}, 'delete_on_termination': True, 'attachment_id': '71453a53-0534-47d9-bfb5-e01f09bd9c90', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:20:07 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:07 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-13T23:19:51Z,direct_url=<?>,disk_format='qcow2',id=51259063-ea79-45f7-9ef9-eea57202ada9,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-908575476',owner='2f7dd660313a41b9a468835b35ceca8b',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-13T23:19:52Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLwmXNDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:07 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:20:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f315dd0-8e05-4583-aa6d-b4ea270e3e01]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:20:07 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75fca10-6889-4e56-a540-7cdbc16dd8ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8] added
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.154s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f8bdf5-d30a-4501-b8c2-387670c0c360]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e854c-c6bd-4c5f-a8e1-6a3128edd9d2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLwmXNDI {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zLwmXNDI" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[00e17f2e-149c-42a0-b28b-0c2047f9d944]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zLwmXNDI'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ff0671-4387-4995-a406-96a326cb941a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[775a55df-87b4-4e91-9aef-05780e19c7fe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: INFO nova.compute.manager [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] instance snapshotting
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eca988d-832d-4235-a57f-99c5b37b1901]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260]
Nov 13 23:20:07 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Beginning live snapshot process
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4b19a7-10d3-4f10-93f1-bb80b33b6430]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc4a58b-00b7-43dc-9827-224b52aed2b0]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:07 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.530s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ba2f47-b362-4f77-8cb2-4db15e84f7d9]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLwmXNDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e.delta 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e.delta 1073741824" returned: 0 in 0.059s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.571s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26332316164353865', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332316164353865', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:08 user nova-compute[75307]: INFO nova.compute.manager [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Terminating instance
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-866801844',id=20,image_ref='51259063-ea79-45f7-9ef9-eea57202ada9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7G4visRKG841WlVYu5siZ4oXYGOkCE6iLt9nt6DrlPmfJv7/S/SZd7g3DgAuy+4Sd2Mnxjrg9VdQt8cCRk2AqgYr0hTGbX7GrOHK0CPId6hyzkzmYveq1SLazYOFWTYg==',key_name='tempest-keypair-1403696912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-spsu4m7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-234629115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=e7eb8413-a53f-45bd-9043-54f23c1c1e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid e7eb8413-a53f-45bd-9043-54f23c1c1e10 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:20:08 user nova-compute[75307]:   <uuid>e7eb8413-a53f-45bd-9043-54f23c1c1e10</uuid>
Nov 13 23:20:08 user nova-compute[75307]:   <name>instance-00000014</name>
Nov 13 23:20:08 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:20:08 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:20:08 user nova-compute[75307]:   <metadata>
Nov 13 23:20:08 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:20:08 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-866801844</nova:name>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:20:07</nova:creationTime>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:20:08 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:20:08 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:owner>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:20:08 user nova-compute[75307]:       </nova:owner>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:root type="image" uuid="51259063-ea79-45f7-9ef9-eea57202ada9"/>
Nov 13 23:20:08 user nova-compute[75307]:       <nova:ports>
Nov 13 23:20:08 user nova-compute[75307]:         <nova:port uuid="986fd54a-b4ec-4e9f-ae09-25dc147be28c">
Nov 13 23:20:08 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:20:08 user nova-compute[75307]:         </nova:port>
Nov 13 23:20:08 user nova-compute[75307]:       </nova:ports>
Nov 13 23:20:08 user nova-compute[75307]:     </nova:instance>
Nov 13 23:20:08 user nova-compute[75307]:   </metadata>
Nov 13 23:20:08 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:20:08 user nova-compute[75307]:     <system>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="serial">e7eb8413-a53f-45bd-9043-54f23c1c1e10</entry>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="uuid">e7eb8413-a53f-45bd-9043-54f23c1c1e10</entry>
Nov 13 23:20:08 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:20:08 user nova-compute[75307]:     </system>
Nov 13 23:20:08 user nova-compute[75307]:   </sysinfo>
Nov 13 23:20:08 user nova-compute[75307]:   <os>
Nov 13 23:20:08 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:20:08 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:20:08 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:20:08 user nova-compute[75307]:   </os>
Nov 13 23:20:08 user nova-compute[75307]:   <features>
Nov 13 23:20:08 user nova-compute[75307]:     <acpi/>
Nov 13 23:20:08 user nova-compute[75307]:     <apic/>
Nov 13 23:20:08 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:20:08 user nova-compute[75307]:   </features>
Nov 13 23:20:08 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:20:08 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:20:08 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:20:08 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:20:08 user nova-compute[75307]:   </clock>
Nov 13 23:20:08 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:20:08 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:20:08 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:20:08 user nova-compute[75307]:   </cpu>
Nov 13 23:20:08 user nova-compute[75307]:   <devices>
Nov 13 23:20:08 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:20:08 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:08 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:20:08 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:20:08 user nova-compute[75307]:       <serial>094fc17c-acc8-4649-a44b-5931f08dc4b8</serial>
Nov 13 23:20:08 user nova-compute[75307]:     </disk>
Nov 13 23:20:08 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:20:08 user nova-compute[75307]:       <mac address="fa:16:3e:81:cb:b1"/>
Nov 13 23:20:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:20:08 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:20:08 user nova-compute[75307]:       <target dev="tap986fd54a-b4"/>
Nov 13 23:20:08 user nova-compute[75307]:     </interface>
Nov 13 23:20:08 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:20:08 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/e7eb8413-a53f-45bd-9043-54f23c1c1e10/console.log" append="off"/>
Nov 13 23:20:08 user nova-compute[75307]:     </serial>
Nov 13 23:20:08 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:20:08 user nova-compute[75307]:     <video>
Nov 13 23:20:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:20:08 user nova-compute[75307]:     </video>
Nov 13 23:20:08 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:20:08 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:20:08 user nova-compute[75307]:     </rng>
Nov 13 23:20:08 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:20:08 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:20:08 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:20:08 user nova-compute[75307]:     </memballoon>
Nov 13 23:20:08 user nova-compute[75307]:   </devices>
Nov 13 23:20:08 user nova-compute[75307]: </domain>
Nov 13 23:20:08 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-866801844',id=20,image_ref='51259063-ea79-45f7-9ef9-eea57202ada9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7G4visRKG841WlVYu5siZ4oXYGOkCE6iLt9nt6DrlPmfJv7/S/SZd7g3DgAuy+4Sd2Mnxjrg9VdQt8cCRk2AqgYr0hTGbX7GrOHK0CPId6hyzkzmYveq1SLazYOFWTYg==',key_name='tempest-keypair-1403696912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-spsu4m7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-234629115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:19:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=e7eb8413-a53f-45bd-9043-54f23c1c1e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG os_vif [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6e969bd0-cc85-5e50-91a1-f97c0e046476', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap986fd54a-b4, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap986fd54a-b4, col_values=(('qos', UUID('263658f9-0963-4ae7-8ff5-eaaaab7bc126')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap986fd54a-b4, col_values=(('external_ids', {'iface-id': '986fd54a-b4ec-4e9f-ae09-25dc147be28c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:cb:b1', 'vm-uuid': 'e7eb8413-a53f-45bd-9043-54f23c1c1e10'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: INFO os_vif [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4')
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:81:cb:b1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-unplugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] No waiting events found dispatching network-vif-unplugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-430dfadf-d1f8-479e-9b56-1eacb5157a31 req-592041d2-077c-4d79-b371-e97ffa93810f service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-unplugged-3328c69f-165f-461b-93c1-20059eb97c33 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.objects.instance [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lazy-loading 'flavor' on Instance uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.128s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] COPY block job progress, current cursor: 23986176 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:09 user nova-compute[75307]: INFO nova.compute.manager [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Attaching volume 14140df3-42fb-453e-aef7-d5c56c4bcb36 to /dev/vdb
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.utils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb1937-38c5-4c26-8e2c-76744e290b19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df312282-bf75-47b6-a755-4dc99c288024]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae175f8-4863-4402-9529-3ac7e5987a2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2e3ca5-e3cf-44ba-8762-47a26e23980d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:10 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0383f50-9abf-4b51-81ee-5458ae1bc368]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_brick.utils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updating existing volume attachment record: 38cc3076-d430-43d6-aa91-2fe1cec355d9 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:10 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.474s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:20:10 user nova-compute[75307]: INFO nova.compute.claims [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Claim successful on node user
Nov 13 23:20:10 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Instance destroyed successfully.
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lazy-loading 'resources' on Instance uuid ea05ed6f-d9fa-4393-beb6-569f50defea6 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-797842599',display_name='tempest-VolumesAdminNegativeTest-server-797842599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-797842599',id=5,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPZVIKZMmBNJO2bT9Sy2yRNscA3mHIVdmnRjIS3OPDjBv0uFuYod24FVjhdOj+m5JJrWsx105V2awBrcnhKVyOeRYAP90Sd/H8//hI1Noej1IT5ovxiTXi3xSjWdxWaxKA==',key_name='tempest-keypair-108270061',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa6bf881a2474024a7f84cc5b93d440e',ramdisk_id='',reservation_id='r-tiafzhgv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-265333520',owner_user_name='tempest-VolumesAdminNegativeTest-265333520-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:14:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6962721fd5104239bdd55f20fd7dc702',uuid=ea05ed6f-d9fa-4393-beb6-569f50defea6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converting VIF {"id": "3328c69f-165f-461b-93c1-20059eb97c33", "address": "fa:16:3e:40:ca:4a", "network": {"id": "a472eb71-01ad-4d64-b98f-79ad6c07d452", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-231082070-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa6bf881a2474024a7f84cc5b93d440e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3328c69f-16", "ovs_interfaceid": "3328c69f-165f-461b-93c1-20059eb97c33", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG os_vif [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3328c69f-16, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e.delta /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e.delta /opt/stack/data/nova/instances/snapshots/tmpnwv0hz9z/893129287a83434297106b92fb59b50e" returned: 0 in 0.821s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:11 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdc18eac-a300-4f89-8621-2075decfec01 is timed out.
Nov 13 23:20:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Snapshot extracted, beginning image upload
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Acquiring lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] No waiting events found dispatching network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:11 user nova-compute[75307]: WARNING nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received unexpected event network-vif-plugged-3328c69f-165f-461b-93c1-20059eb97c33 for instance with vm_state active and task_state deleting.
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] No waiting events found dispatching network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:11 user nova-compute[75307]: WARNING nova.compute.manager [req-01437a35-220f-4a37-8969-c63410db1155 req-dfc81a7f-cdd1-45d1-800b-c1a566534056 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received unexpected event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c for instance with vm_state building and task_state spawning.
Nov 13 23:20:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d6fde78d-a534-4f48-83b2-613c3c15718c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdb from instance fdc18eac-a300-4f89-8621-2075decfec01 from the live domain config.
Nov 13 23:20:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:11 user nova-compute[75307]: INFO os_vif [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:40:ca:4a,bridge_name='br-int',has_traffic_filtering=True,id=3328c69f-165f-461b-93c1-20059eb97c33,network=Network(a472eb71-01ad-4d64-b98f-79ad6c07d452),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3328c69f-16')
Nov 13 23:20:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Deleting instance files /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6_del
Nov 13 23:20:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Deletion of /opt/stack/data/nova/instances/ea05ed6f-d9fa-4393-beb6-569f50defea6_del complete
Nov 13 23:20:11 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:11 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7393MB free_disk=25.450481414794922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EOsiBCvZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:11 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[36903754-8a64-4f2f-9070-b90a9395f96b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:20:11 user nova-compute[75307]: No targets found.
Nov 13 23:20:11 user nova-compute[75307]: iSNS:
Nov 13 23:20:11 user nova-compute[75307]: No targets found.
Nov 13 23:20:11 user nova-compute[75307]: STATIC:
Nov 13 23:20:11 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:20:11 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:11 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:11 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3
Nov 13 23:20:11 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:11 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:11 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:20:11 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:11 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:11 user nova-compute[75307]: FIRMWARE:
Nov 13 23:20:11 user nova-compute[75307]: No targets found.
Nov 13 23:20:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:20:11 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:20:11 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:20:11 user nova-compute[75307]: INFO nova.compute.manager [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Took 3.02 seconds to destroy the instance on the hypervisor.
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d454b7a-88f8-4964-b35b-f65c80465914]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c7ad0-b96b-40b8-88c7-be73b6a5e9fe]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:11 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:11 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 (non-flash)
Nov 13 23:20:11 user nova-compute[75307]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:11 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34230940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d9c0d4-6bbe-4556-90e7-ba71378207be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2622dd-1186-4190-a409-53ef69c500e8]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2177601b-fbb4-4646-b4e2-dbcd04208269]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa43a29-621d-411a-b67c-4374ada69161]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b944c9-b2f2-41d6-bdd7-72eb18ff77db]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef63263-9409-4f7f-9a04-beebb11422e7]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260]
Nov 13 23:20:12 user nova-compute[75307]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:12 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fa7e5b5-1058-4b37-a5eb-8f9dc68004e3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e34ee0f-63b2-43fe-94b3-003a9370a48b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== disconnect_volume: return (359ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.489s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.565s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:20:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ea05ed6f-d9fa-4393-beb6-569f50defea6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e6c464b7-a6ae-4f78-9159-5643d52c2295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e7eb8413-a53f-45bd-9043-54f23c1c1e10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.policy [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1dadb69ade9241539a1d0747d728d403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c26ffef772d4f5bb79d88595d519ebc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:20:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Creating image(s)
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "/opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "/opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:12 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Took 0.90 seconds to deallocate network for instance.
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.732s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.263s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.214s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk 1073741824" returned: 0 in 0.051s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:20:13 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Instance spawned successfully.
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] No waiting events found dispatching network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:13 user nova-compute[75307]: WARNING nova.compute.manager [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received unexpected event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c for instance with vm_state building and task_state spawning.
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-bec04fae-e5b5-4776-ba36-45f5d604b046 req-4a3b58da-452f-48ca-9e20-a821fe9911fd service nova] [instance: ea05ed6f-d9fa-4393-beb6-569f50defea6] Received event network-vif-deleted-3328c69f-165f-461b-93c1-20059eb97c33 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:13 user nova-compute[75307]: INFO nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.231s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Successfully created port: 2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:20:13 user nova-compute[75307]: INFO nova.compute.manager [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Took 17.58 seconds to build instance.
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-dba3f2ce-5e14-4017-9e66-461d0a56576e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.749s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Cannot resize image /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Ensure instance console log exists: /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.689s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:13 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Deleted allocations for instance ea05ed6f-d9fa-4393-beb6-569f50defea6
Nov 13 23:20:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00922dc3-ce83-4ca0-aeff-b8a27b3be0c3 tempest-VolumesAdminNegativeTest-265333520 tempest-VolumesAdminNegativeTest-265333520-project-member] Lock "ea05ed6f-d9fa-4393-beb6-569f50defea6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.136s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Successfully updated port: 2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquired lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received event network-changed-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Refreshing instance network info cache due to event network-changed-2d5bcd47-a6e8-455c-8136-245972dbac84. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] Acquiring lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating instance_info_cache with network_info: [{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Releasing lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Instance network_info: |[{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] Acquired lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Refreshing network info cache for port 2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Start _get_guest_xml network_info=[{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:20:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48710663',display_name='tempest-SnapshotDataIntegrityTests-server-48710663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48710663',id=21,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOR2zWZyqc6QrrfNiub+NcJlSIuulmT/MWMPubLdVWgJDac3dkNuVVB8i29ES9hFYrOcwbcSrUtxMWLol2SYY1ZiHvhcGuHwzg7UiyUbQFyjRYUtvesKCiUL3lRHnB1qQ==',key_name='tempest-keypair-737270727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c26ffef772d4f5bb79d88595d519ebc',ramdisk_id='',reservation_id='r-ffup8n3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1226104925',owner_user_name='tempest-SnapshotDataIntegrityTests-1226104925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:20:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dadb69ade9241539a1d0747d728d403',uuid=5f309889-e21b-4311-a2c0-28b955011b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converting VIF {"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.objects.instance [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Snapshot image upload complete
Nov 13 23:20:14 user nova-compute[75307]: INFO nova.compute.manager [None req-74390760-6199-4cb3-8a37-b5d16bb91478 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Took 7.05 seconds to snapshot the instance on the hypervisor.
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:20:14 user nova-compute[75307]:   <uuid>5f309889-e21b-4311-a2c0-28b955011b38</uuid>
Nov 13 23:20:14 user nova-compute[75307]:   <name>instance-00000015</name>
Nov 13 23:20:14 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:20:14 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:20:14 user nova-compute[75307]:   <metadata>
Nov 13 23:20:14 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:20:14 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-48710663</nova:name>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:20:14</nova:creationTime>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:20:14 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:20:14 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:owner>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:user uuid="1dadb69ade9241539a1d0747d728d403">tempest-SnapshotDataIntegrityTests-1226104925-project-member</nova:user>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:project uuid="7c26ffef772d4f5bb79d88595d519ebc">tempest-SnapshotDataIntegrityTests-1226104925</nova:project>
Nov 13 23:20:14 user nova-compute[75307]:       </nova:owner>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:20:14 user nova-compute[75307]:       <nova:ports>
Nov 13 23:20:14 user nova-compute[75307]:         <nova:port uuid="2d5bcd47-a6e8-455c-8136-245972dbac84">
Nov 13 23:20:14 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 13 23:20:14 user nova-compute[75307]:         </nova:port>
Nov 13 23:20:14 user nova-compute[75307]:       </nova:ports>
Nov 13 23:20:14 user nova-compute[75307]:     </nova:instance>
Nov 13 23:20:14 user nova-compute[75307]:   </metadata>
Nov 13 23:20:14 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:20:14 user nova-compute[75307]:     <system>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="serial">5f309889-e21b-4311-a2c0-28b955011b38</entry>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="uuid">5f309889-e21b-4311-a2c0-28b955011b38</entry>
Nov 13 23:20:14 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:20:14 user nova-compute[75307]:     </system>
Nov 13 23:20:14 user nova-compute[75307]:   </sysinfo>
Nov 13 23:20:14 user nova-compute[75307]:   <os>
Nov 13 23:20:14 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:20:14 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:20:14 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:20:14 user nova-compute[75307]:   </os>
Nov 13 23:20:14 user nova-compute[75307]:   <features>
Nov 13 23:20:14 user nova-compute[75307]:     <acpi/>
Nov 13 23:20:14 user nova-compute[75307]:     <apic/>
Nov 13 23:20:14 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:20:14 user nova-compute[75307]:   </features>
Nov 13 23:20:14 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:20:14 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:20:14 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:20:14 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:20:14 user nova-compute[75307]:   </clock>
Nov 13 23:20:14 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:20:14 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:20:14 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:20:14 user nova-compute[75307]:   </cpu>
Nov 13 23:20:14 user nova-compute[75307]:   <devices>
Nov 13 23:20:14 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:20:14 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:20:14 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk"/>
Nov 13 23:20:14 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:20:14 user nova-compute[75307]:     </disk>
Nov 13 23:20:14 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:20:14 user nova-compute[75307]:       <mac address="fa:16:3e:80:4b:90"/>
Nov 13 23:20:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:20:14 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:20:14 user nova-compute[75307]:       <target dev="tap2d5bcd47-a6"/>
Nov 13 23:20:14 user nova-compute[75307]:     </interface>
Nov 13 23:20:14 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:20:14 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/console.log" append="off"/>
Nov 13 23:20:14 user nova-compute[75307]:     </serial>
Nov 13 23:20:14 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:20:14 user nova-compute[75307]:     <video>
Nov 13 23:20:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:20:14 user nova-compute[75307]:     </video>
Nov 13 23:20:14 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:20:14 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:20:14 user nova-compute[75307]:     </rng>
Nov 13 23:20:14 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:20:14 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:20:14 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:20:14 user nova-compute[75307]:     </memballoon>
Nov 13 23:20:14 user nova-compute[75307]:   </devices>
Nov 13 23:20:14 user nova-compute[75307]: </domain>
Nov 13 23:20:14 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48710663',display_name='tempest-SnapshotDataIntegrityTests-server-48710663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48710663',id=21,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOR2zWZyqc6QrrfNiub+NcJlSIuulmT/MWMPubLdVWgJDac3dkNuVVB8i29ES9hFYrOcwbcSrUtxMWLol2SYY1ZiHvhcGuHwzg7UiyUbQFyjRYUtvesKCiUL3lRHnB1qQ==',key_name='tempest-keypair-737270727',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c26ffef772d4f5bb79d88595d519ebc',ramdisk_id='',reservation_id='r-ffup8n3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1226104925',owner_user_name='tempest-SnapshotDataIntegrityTests-1226104925-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:20:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dadb69ade9241539a1d0747d728d403',uuid=5f309889-e21b-4311-a2c0-28b955011b38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converting VIF {"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG os_vif [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3cf1c0ce-ca71-5cf1-bbe6-254aad3ae56b', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d5bcd47-a6, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d5bcd47-a6, col_values=(('qos', UUID('4dabf9e3-964f-4cd5-b151-e26e63ad0c2f')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d5bcd47-a6, col_values=(('external_ids', {'iface-id': '2d5bcd47-a6e8-455c-8136-245972dbac84', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:4b:90', 'vm-uuid': '5f309889-e21b-4311-a2c0-28b955011b38'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:14 user nova-compute[75307]: INFO os_vif [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6')
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No VIF found with MAC fa:16:3e:80:4b:90, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updated VIF entry in instance network info cache for port 2d5bcd47-a6e8-455c-8136-245972dbac84. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating instance_info_cache with network_info: [{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d53d9d5-dae9-4a86-9aa7-ab9d4fe4468c req-4b413803-7aad-47b5-872f-fc628ea413a1 service nova] Releasing lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG nova.objects.instance [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-702ed278-c317-4126-af9c-42f0625ac455 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.974s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPsRltV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:15 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:15 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:15 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85565df4-9fef-4067-a014-bde7b2670e6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:20:15 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c283f316-9f11-4bfe-aaf0-27ff0332e99f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36] added
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc3bd42-2698-4ef0-974d-a15f53c48b7c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[72be5352-b4a3-4250-9b62-3aebb9cb9364]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPsRltV {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPsRltV" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a120f8d1-3a69-42b9-aa6d-0ff61c06e49b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzPsRltV'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a8946b-bdbb-4a91-b8e3-6fb9ff71e851]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[192a6d97-1f2f-4b68-a718-3e2b7e17349f]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ca9254-34b0-4641-93c8-bcbb56ede6a4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260]
Nov 13 23:20:15 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[abec6588-ced3-498a-bdf2-f716233de129]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc711f4d-527d-487b-8b91-f9234c2f92d4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc213299-0674-4ebf-b70f-286273d3fe47]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPsRltV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:20:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received event network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] No waiting events found dispatching network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:16 user nova-compute[75307]: WARNING nova.compute.manager [req-37e8d7ff-dc47-4a72-b945-012cbf2c1adf req-03129b78-68f6-4090-9f35-b4b510718195 service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received unexpected event network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 for instance with vm_state building and task_state spawning.
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75307) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:16 user nova-compute[75307]: WARNING nova.compute.manager [req-cd86988d-8e56-43b9-9446-1f3d20cc00d8 req-b633352e-3dd3-41c7-80c4-d631c0504236 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state active and task_state powering-off.
Nov 13 23:20:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26431366532643739', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431366532643739', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lazy-loading 'flavor' on Instance uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:20:16 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:16 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:20:16 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:16 user nova-compute[75307]:   <serial>14140df3-42fb-453e-aef7-d5c56c4bcb36</serial>
Nov 13 23:20:16 user nova-compute[75307]: </disk>
Nov 13 23:20:16 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance destroyed successfully.
Nov 13 23:20:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-15ae3ae1-ec3e-475c-92f0-00866b4bdd5b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.954s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] No VIF found with MAC fa:16:3e:3f:71:92, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5008623e-df6d-4556-865e-34ed563cc16d tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.917s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received event network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] No waiting events found dispatching network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:18 user nova-compute[75307]: WARNING nova.compute.manager [req-d800898b-dbcb-44cf-92d4-c89d4b3a1e76 req-7bc72468-1cc2-40ff-a040-505e97b1227c service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received unexpected event network-vif-plugged-2d5bcd47-a6e8-455c-8136-245972dbac84 for instance with vm_state building and task_state spawning.
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:20:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Instance spawned successfully.
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:20:18 user nova-compute[75307]: INFO nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Took 6.03 seconds to spawn the instance on the hypervisor.
Nov 13 23:20:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:18 user nova-compute[75307]: INFO nova.compute.manager [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Took 8.28 seconds to build instance.
Nov 13 23:20:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-24922401-1b2e-4718-b228-c0b5cedc3cb7 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.552s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:19 user nova-compute[75307]: WARNING nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:19 user nova-compute[75307]: WARNING nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:19 user nova-compute[75307]: WARNING nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:19 user nova-compute[75307]: WARNING nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:19 user nova-compute[75307]: WARNING nova.compute.manager [req-9eec9a10-1d1a-4aa5-8478-7d8a544d9a28 req-5053db88-2e20-4282-bf28-b67f8bc7eb42 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state None.
Nov 13 23:20:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-changed-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Refreshing instance network info cache due to event network-changed-b8af2747-4849-4506-8dba-1f948bc07137. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] Acquiring lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] Acquired lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Refreshing network info cache for port b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:20 user nova-compute[75307]: INFO nova.compute.manager [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Detaching volume 14140df3-42fb-453e-aef7-d5c56c4bcb36
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lazy-loading 'flavor' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:20 user nova-compute[75307]: INFO nova.virt.block_device [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Attempting to driver detach volume 14140df3-42fb-453e-aef7-d5c56c4bcb36 from mountpoint /dev/vdb
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Attempting to detach device vdb from instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:20:20 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:20 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:20:20 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:20 user nova-compute[75307]:   <serial>14140df3-42fb-453e-aef7-d5c56c4bcb36</serial>
Nov 13 23:20:20 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:20:20 user nova-compute[75307]: </disk>
Nov 13 23:20:20 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Successfully detached device vdb from instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 from the persistent domain config.
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:20:20 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:20 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:20:20 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:20 user nova-compute[75307]:   <serial>14140df3-42fb-453e-aef7-d5c56c4bcb36</serial>
Nov 13 23:20:20 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:20:20 user nova-compute[75307]: </disk>
Nov 13 23:20:20 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updated VIF entry in instance network info cache for port b8af2747-4849-4506-8dba-1f948bc07137. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updating instance_info_cache with network_info: [{"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b55a1ddf-479a-4a82-8ad9-07e8050c1b5e req-977ddd89-8343-4b68-8403-b7ebfaa1368e service nova] Releasing lock "refresh_cache-d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:21 user nova-compute[75307]: INFO nova.compute.manager [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attaching volume bc64eefe-f80c-4e5e-b510-6308eb0292ee to /dev/vdb
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aeb19af-9902-40fd-8ed2-3881fd810262]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22d1e27-0cd9-4539-b0bf-10e215b1cffb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ef3f62-3fb1-4ee2-b373-9810b9a0f77b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f38149-ab9c-49c3-a9bc-8c44e80a1817]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:21 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:20:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c8bddd-1b9c-450e-b5d5-fe785374670e]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updating existing volume attachment record: c156804e-14f5-470b-8c5a-079061b0a2de {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:20:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:20:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:25 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e3387-6313-40e4-a351-2f3ff3e3d74d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:20:25 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2bbf64-2216-4a64-8ae0-fde2e8c747e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee] added
Nov 13 23:20:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb13f5-8c2a-4525-a4d5-6615095a41f3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[25646bb4-b931-40ef-b327-618ea671b7a0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZalsUTxv {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZalsUTxv" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1bcca0-ccf0-4ae5-86fe-b348108133a2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZalsUTxv'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[967b08c0-fbfc-4c62-911a-4ada179740a6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[07249865-0d8f-426d-81a6-63f521be54e2]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:25 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:25 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:25 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:25 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66fada8-6ec1-4c93-b867-b60b293a8129]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]
Nov 13 23:20:25 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9156d6e-61b5-4c10-9188-3b817642bc6d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ccb9ec-8070-4bc9-a2f2-fec7edf59c8c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:26 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060a38f-aff9-4194-8a22-f76368ee72a2]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23235383438656365', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383438656365', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.objects.instance [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lazy-loading 'flavor' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:20:27 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:27 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:20:27 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:27 user nova-compute[75307]:   <serial>bc64eefe-f80c-4e5e-b510-6308eb0292ee</serial>
Nov 13 23:20:27 user nova-compute[75307]: </disk>
Nov 13 23:20:27 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] No VIF found with MAC fa:16:3e:d9:10:e0, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:20:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-43a115d7-9304-4bdf-a307-ff734c3384f9 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.590s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.utils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d57d3eb-2523-4e72-a883-cc61510ae6c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7aa72a-8db3-4dd8-a2ed-062ae85adcfe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2b6428-bed4-443c-bff8-11a03cffe913]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5402b1bc-6ce9-49f1-a420-0927fcc3fb5e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:29 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:20:29 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab66be-553f-43e3-a59b-422710bd9d53]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:20:29 user nova-compute[75307]: DEBUG os_brick.utils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:29 user nova-compute[75307]: INFO nova.compute.manager [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Swapping volume bc64eefe-f80c-4e5e-b510-6308eb0292ee for d64dc8da-6d3f-4d36-a51b-b3698fb10b8c
Nov 13 23:20:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'serial': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'serial'} {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:33 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:33 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:33 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5295c6c-c7e6-45cc-bb51-abb19fa1f081]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:20:33 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45a67c8-46cd-4d55-8ecf-a42b7a181915]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c] added
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[41444fa8-d4ba-489e-808d-3b17cc4e5f7c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3241d8-e73d-45a8-9c16-15085e9353ff]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqPflaOj {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bqPflaOj" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eec0c4b-2eb2-4c67-a206-32b3c150ceef]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bqPflaOj'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab3dd84-0a2f-4f20-be7b-801b1b08043b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[250e1824-d1c6-4c24-b603-ade4c2e4a8d8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[43244b1c-f7c2-426b-ab42-a6dd9fc3b66f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260]
Nov 13 23:20:33 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14a9864-2382-49c4-ab3a-f03649598597]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b72fe4a-9660-42a2-91e6-8dbe33334451]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:33 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] HCTL ('37', '-', '-', 0) found on session 23 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1202a13c-e9a2-4000-9778-505d8ffc7995]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Searching for a device in session 23 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26362366333373863', 'path': '/dev/sdf'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362366333373863', 'path': '/dev/sdf'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lazy-loading 'flavor' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 101711872 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 279969792 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 452984832 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 628097024 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 981467136 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:38 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[43da7f61-82b2-4fd7-a943-62126c70b27c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:20:38 user nova-compute[75307]: No targets found.
Nov 13 23:20:38 user nova-compute[75307]: iSNS:
Nov 13 23:20:38 user nova-compute[75307]: No targets found.
Nov 13 23:20:38 user nova-compute[75307]: STATIC:
Nov 13 23:20:38 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:20:38 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:38 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:38 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c
Nov 13 23:20:38 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:38 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:38 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee
Nov 13 23:20:38 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:38 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:38 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36
Nov 13 23:20:38 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:38 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:38 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:20:38 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:38 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:38 user nova-compute[75307]: FIRMWARE:
Nov 13 23:20:38 user nova-compute[75307]: No targets found.
Nov 13 23:20:38 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:20:38 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:20:38 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[94203c2a-fd99-4b36-b94b-475a60de72b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d161178-04e3-4ef2-b6f0-8f698e0314ed]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:38 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:38 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:38 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb345a3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f37f93-664e-4290-9f9a-932edccce19b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b691b29-1208-4b43-8626-535d0fbd5574]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec09bf74-d4a0-4b8f-a8d4-26ac1cec9204]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd2f20-34da-45ed-8a7d-a258b6681a94]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[54833cfa-f976-4a6a-aa69-c31964def083]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d93ba-bfba-432c-94c6-4666778930f8]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]
Nov 13 23:20:38 user nova-compute[75307]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:38 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31f1dad-905f-4746-a016-de5875fe90c7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== disconnect_volume: return (299ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'serial'} {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 23:20:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: removing Cinder connection for volume bc64eefe-f80c-4e5e-b510-6308eb0292ee {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 23:20:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: Updating volume bc64eefe-f80c-4e5e-b510-6308eb0292ee BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "bqPflaOj", "auth_password": "sPAR5VoIMzLglK", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "d64dc8da-6d3f-4d36-a51b-b3698fb10b8c"}, "status": "reserved", "instance": "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c", "attached_at": "", "detached_at": "", "volume_id": "d64dc8da-6d3f-4d36-a51b-b3698fb10b8c", "serial": "d64dc8da-6d3f-4d36-a51b-b3698fb10b8c"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'no_device': None, 'attachment_id': 'd074b28e-aeb0-4891-9995-e4a86450c870'} {{(pid=75307) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 23:20:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-64d39909-7dcf-4cf9-8075-102c453fed92 tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 10.727s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:39 user nova-compute[75307]: INFO nova.compute.manager [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Unrescuing
Nov 13 23:20:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:39 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'flavor' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:40 user nova-compute[75307]: WARNING nova.compute.manager [req-85f1add4-4e04-4c75-a8a2-d07a75d79aaa req-8d3a73b5-df27-4010-9894-b65fc1a7b3a2 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-unplugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:20:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance destroyed successfully.
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.utils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f08b67f-924c-4751-b767-41107321c27c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b19379-6360-4929-9766-56b2e80123dd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7a0230-f4b2-415e-92af-fe2102bd9994]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2543806b-db71-4552-b8a6-c6dc75538daa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:20:41 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3842190-ed84-4838-ac45-e7b66a9b74eb]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.utils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 is timed out.
Nov 13 23:20:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Successfully detached device vdb from instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 from the live domain config.
Nov 13 23:20:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPsRltV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a41c3a-ac76-448f-a257-370ed3559168]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:20:41 user nova-compute[75307]: No targets found.
Nov 13 23:20:41 user nova-compute[75307]: iSNS:
Nov 13 23:20:41 user nova-compute[75307]: No targets found.
Nov 13 23:20:41 user nova-compute[75307]: STATIC:
Nov 13 23:20:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:20:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c
Nov 13 23:20:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36
Nov 13 23:20:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:20:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:41 user nova-compute[75307]: FIRMWARE:
Nov 13 23:20:41 user nova-compute[75307]: No targets found.
Nov 13 23:20:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:20:41 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:20:41 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec8f842-37fd-45bf-b268-75344e2bfd0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d6e137-3440-4cf7-a8a1-b3f9a6a5b41e]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 (non-flash)
Nov 13 23:20:41 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3459ee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:20:41 user nova-compute[75307]: INFO nova.compute.manager [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Swapping volume d64dc8da-6d3f-4d36-a51b-b3698fb10b8c for bc64eefe-f80c-4e5e-b510-6308eb0292ee
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83b46cc-8edd-4133-a350-9c97190e8a3c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6a50332-37de-407e-bc06-142b821ca8fd]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1d2ce4-a0a6-4900-b538-b860184597a9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9646fafd-8b82-4ea5-a142-70a4c2f8180c]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dacb583-b01f-446d-9721-b330113b05cd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e698557-b522-43f4-a7f4-0c253fdf18b2]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260]
Nov 13 23:20:41 user nova-compute[75307]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:14140df3-42fb-453e-aef7-d5c56c4bcb36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59d237c-7505-4098-ac65-2b96ffb186dd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] <== disconnect_volume: return (313ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG nova.objects.instance [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lazy-loading 'flavor' on Instance uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-88ae2e5f-6f11-4081-b944-c1069d1f9a05 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.884s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:42 user nova-compute[75307]: WARNING nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:20:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:42 user nova-compute[75307]: WARNING nova.compute.manager [req-daed8faf-2f1c-4d15-bfbb-7822f11f8f42 req-d449b2ec-230d-4fa8-a7ed-802e9dc00a0c service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:20:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3bb6863d-cc59-4cda-9189-ca56939932be tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG nova.compute.manager [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:44 user nova-compute[75307]: DEBUG nova.compute.manager [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] No waiting events found dispatching network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:20:44 user nova-compute[75307]: WARNING nova.compute.manager [req-261cd79a-1c5f-420e-a7e8-8c08775c592e req-ead5e0c6-af75-4f5d-abf3-537d09724d72 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received unexpected event network-vif-plugged-92e3832b-fb83-4ed1-8a9a-bc575a008b87 for instance with vm_state active and task_state None.
Nov 13 23:20:45 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'serial': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c'}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'serial'} {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:45 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:45 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:45 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b3e6c6-86bb-4c9e-a41f-fd56238ad2e7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:20:45 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3b6910-0dc0-498b-a678-318947ad31fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee] added
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfab357d-f013-469e-80e6-c783fadfd881]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2132909-baa6-4832-9926-c74203173050]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZalsUTxv {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZalsUTxv" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca18528e-0a7e-4864-beac-191163ae9469]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZalsUTxv'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8746c475-dd80-46ec-90f7-4a22e4a95ab3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedfb377-b658-4438-b0ad-463343ff53bc]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac6010c-368f-445a-951a-3782c9ec520e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]
Nov 13 23:20:45 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[937c7dde-b696-4c49-be15-7fbab6c2beb8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d3f9b1-d29b-49a3-9bc4-081a6036b734]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:45 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc2bf7d-a152-4e8d-8a64-45e1e29ef818]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:45 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:46 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23235383438656365', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235383438656365', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lazy-loading 'flavor' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 2097152 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 136314880 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 231735296 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 390070272 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 546308096 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 675282944 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 810549248 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 865075200 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-changed-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing instance network info cache due to event network-changed-872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG nova.network.neutron [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing network info cache for port 872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:20:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.network.neutron [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated VIF entry in instance network info cache for port 872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.network.neutron [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc2e3968-c1db-4483-819b-50aee2df79b7 req-4b7b2f4c-7f75-40ce-89f7-3097b0c43478 service nova] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bqPflaOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': 'd64dc8da-6d3f-4d36-a51b-b3698fb10b8c'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:20:52 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[06956f8d-c0ce-4d09-9b1f-874c839e2e4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:20:52 user nova-compute[75307]: No targets found.
Nov 13 23:20:52 user nova-compute[75307]: iSNS:
Nov 13 23:20:52 user nova-compute[75307]: No targets found.
Nov 13 23:20:52 user nova-compute[75307]: STATIC:
Nov 13 23:20:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:20:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c
Nov 13 23:20:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee
Nov 13 23:20:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:20:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:20:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:20:52 user nova-compute[75307]: FIRMWARE:
Nov 13 23:20:52 user nova-compute[75307]: No targets found.
Nov 13 23:20:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:20:52 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:20:52 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0171ae31-5e87-4484-a5ee-c0204972b4ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8a409a-fa7b-456b-9f85-3960a2519a46]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c (non-flash)
Nov 13 23:20:52 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:20:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb345a0430>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c'): ({'sdf'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Removing single pathed devices sdf {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee89f8cd-ef47-4825-9817-8c0c139fd2d1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[738e386f-e37e-48d3-a8e6-2cb30520c155]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Flushing IO for device /dev/sdf {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cb15e1-c507-4c1d-ba3e-b03a2dd1b370]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae599cd-af1b-451e-ad20-704471bb295d]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29a509-0648-4bf2-847a-0d005ca18bdc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1493a81-ec54-48a7-8cf5-f0c1864db8c3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260]
Nov 13 23:20:52 user nova-compute[75307]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c, portal: 172.16.0.220,3260] successful.
Nov 13 23:20:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d64dc8da-6d3f-4d36-a51b-b3698fb10b8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc92235-81e6-45cb-832e-8f1d5ad358cf]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] <== disconnect_volume: return (296ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'd2b088e1-c3d9-4f82-86ef-a24cdaecff1c', 'attached_at': '', 'detached_at': '', 'volume_id': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'serial'} {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 13 23:20:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: removing Cinder connection for volume d64dc8da-6d3f-4d36-a51b-b3698fb10b8c {{(pid=75307) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 13 23:20:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] swap_volume: Updating volume d64dc8da-6d3f-4d36-a51b-b3698fb10b8c BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ZalsUTxv", "auth_password": "Gd6QYpkMNtjHiZ", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "bc64eefe-f80c-4e5e-b510-6308eb0292ee"}, "status": "reserved", "instance": "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c", "attached_at": "", "detached_at": "", "volume_id": "bc64eefe-f80c-4e5e-b510-6308eb0292ee", "serial": "bc64eefe-f80c-4e5e-b510-6308eb0292ee"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'no_device': None, 'attachment_id': '7b9f138a-822f-45c7-b72a-d409a1581739'} {{(pid=75307) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 13 23:20:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d1657eff-fdd6-4504-8d67-f4d3554673cc tempest-TestVolumeSwap-593125526 tempest-TestVolumeSwap-593125526-project-admin] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.961s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:54 user nova-compute[75307]: INFO nova.compute.manager [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Detaching volume bc64eefe-f80c-4e5e-b510-6308eb0292ee
Nov 13 23:20:54 user nova-compute[75307]: INFO nova.virt.block_device [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Attempting to driver detach volume bc64eefe-f80c-4e5e-b510-6308eb0292ee from mountpoint /dev/vdb
Nov 13 23:20:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Attempting to detach device vdb from instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:20:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:20:54 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:54 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:20:54 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:54 user nova-compute[75307]:   <serial>bc64eefe-f80c-4e5e-b510-6308eb0292ee</serial>
Nov 13 23:20:54 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:20:54 user nova-compute[75307]: </disk>
Nov 13 23:20:54 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:20:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Successfully detached device vdb from instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c from the persistent domain config.
Nov 13 23:20:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:20:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:20:54 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:20:54 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:20:54 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:20:54 user nova-compute[75307]:   <serial>bc64eefe-f80c-4e5e-b510-6308eb0292ee</serial>
Nov 13 23:20:54 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:20:54 user nova-compute[75307]: </disk>
Nov 13 23:20:54 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:20:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:20:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 8bf8a928-35cc-413a-b7e8-5afeecb20924 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid e6c464b7-a6ae-4f78-9159-5643d52c2295 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid e7eb8413-a53f-45bd-9043-54f23c1c1e10 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:20:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:21:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:21:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=25.386276245117188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e6c464b7-a6ae-4f78-9159-5643d52c2295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance e7eb8413-a53f-45bd-9043-54f23c1c1e10 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:21:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:21:11 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:11 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:11 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:21:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.628s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:21:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:13 user nova-compute[75307]: INFO nova.compute.manager [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Terminating instance
Nov 13 23:21:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Instance destroyed successfully.
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lazy-loading 'resources' on Instance uuid 1c3d5443-61e1-42b7-8c5d-7978dddfb096 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-612195959',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-6121959',id=16,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXfiVlkfgB25VBiN2JLkY5rjnTwc+Fv9/EWKTG/7Q32FjN9/ncGJJ8wfL7ClCt1JPyMgiX616rd7DMPEHZlkNh/fEoF17IzxQTF8pOeZUCpkr5hbDmXEsH5FJc5foFd/g==',key_name='tempest-keypair-1133104409',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4f3581a1d5b54b9894827114a10899c8',ramdisk_id='',reservation_id='r-lad09l0e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:18:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ba43ad1078064bf08022407a4f625e92',uuid=1c3d5443-61e1-42b7-8c5d-7978dddfb096,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converting VIF {"id": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "address": "fa:16:3e:3f:71:92", "network": {"id": "048ccf1c-f665-44de-bc0c-1f7a08fafeca", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1310585042-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4f3581a1d5b54b9894827114a10899c8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5d6ee9b0-31", "ovs_interfaceid": "5d6ee9b0-3165-4d44-b8b8-6da961157b88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG os_vif [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5d6ee9b0-31, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5cdaa1c7-83b0-4bdb-b938-580bda6ce53e) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:14 user nova-compute[75307]: INFO os_vif [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:71:92,bridge_name='br-int',has_traffic_filtering=True,id=5d6ee9b0-3165-4d44-b8b8-6da961157b88,network=Network(048ccf1c-f665-44de-bc0c-1f7a08fafeca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5d6ee9b0-31')
Nov 13 23:21:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Deleting instance files /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096_del
Nov 13 23:21:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Deletion of /opt/stack/data/nova/instances/1c3d5443-61e1-42b7-8c5d-7978dddfb096_del complete
Nov 13 23:21:14 user nova-compute[75307]: INFO nova.compute.manager [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 23:21:14 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:21:14 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:21:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c is timed out.
Nov 13 23:21:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Successfully detached device vdb from instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c from the live domain config.
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZalsUTxv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'bc64eefe-f80c-4e5e-b510-6308eb0292ee'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:21:15 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb4549c-cf7a-4c1d-965f-f78fc3e7e27c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:21:15 user nova-compute[75307]: No targets found.
Nov 13 23:21:15 user nova-compute[75307]: iSNS:
Nov 13 23:21:15 user nova-compute[75307]: No targets found.
Nov 13 23:21:15 user nova-compute[75307]: STATIC:
Nov 13 23:21:15 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:21:15 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:21:15 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:21:15 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee
Nov 13 23:21:15 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:21:15 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:21:15 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:21:15 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:21:15 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:21:15 user nova-compute[75307]: FIRMWARE:
Nov 13 23:21:15 user nova-compute[75307]: No targets found.
Nov 13 23:21:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:21:15 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:21:15 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7bf52e-5530-400d-ba5b-4f95e8b6bc15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4c0bc8-9793-4b67-8bf0-061ce1d40b87]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:21:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:21:15 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:21:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:21:15 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:21:15 user nova-compute[75307]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee (non-flash)
Nov 13 23:21:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3cf13b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5721ed7f-e0f7-4933-aea2-6c3b6543f8fc]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4892fb-0e70-444c-8e5f-182d97e978ae]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Took 0.91 seconds to deallocate network for instance.
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed3444b-1de9-4750-972a-d2a64cee7046]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-8e60a471-ecad-487b-98f7-34c89bedb59c req-7304b5c3-cb27-4cba-9292-09f06e87e28a service nova] [instance: 1c3d5443-61e1-42b7-8c5d-7978dddfb096] Received event network-vif-deleted-5d6ee9b0-3165-4d44-b8b8-6da961157b88 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a73a14-f31d-4893-a62c-3097045d23c5]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45fc4b-b791-495b-8f3f-296987e8f6ca]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc93f1-64e1-48eb-8fba-12e1346ab873]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260]
Nov 13 23:21:15 user nova-compute[75307]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee, portal: 172.16.0.220,3260] successful.
Nov 13 23:21:15 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bc64eefe-f80c-4e5e-b510-6308eb0292ee -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce501d8-3e5a-47df-82e5-053349416d97]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] <== disconnect_volume: return (317ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:15 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Deleted allocations for instance 1c3d5443-61e1-42b7-8c5d-7978dddfb096
Nov 13 23:21:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d6ae0de-23d3-4040-9ffe-84782a27f8c8 tempest-TestServerVolumeAttachScenarioOldVersion-150471311 tempest-TestServerVolumeAttachScenarioOldVersion-150471311-project-member] Lock "1c3d5443-61e1-42b7-8c5d-7978dddfb096" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.364s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lazy-loading 'flavor' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9bd03c3-d152-4449-a49b-c2bc84b61c78 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.601s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 16.465s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:21:16 user nova-compute[75307]: INFO nova.compute.claims [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Claim successful on node user
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:21:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.policy [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '025c402ce1bc4de7a718a2b5e119b4ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9031887798954fab9ea96c7ce9c30984', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:21:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Creating image(s)
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk 1073741824" returned: 0 in 0.054s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Successfully created port: 47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Cannot resize image /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Ensure instance console log exists: /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Successfully updated port: 47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-changed-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Refreshing instance network info cache due to event network-changed-47e669d9-2897-4d52-8611-36afbf74c293. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance network_info: |[{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Refreshing network info cache for port 47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start _get_guest_xml network_info=[{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:21:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:21:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'pci_devices' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:21:18 user nova-compute[75307]:   <uuid>a90dad03-c454-4728-a5a6-cf5759a41ed7</uuid>
Nov 13 23:21:18 user nova-compute[75307]:   <name>instance-00000016</name>
Nov 13 23:21:18 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:21:18 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:21:18 user nova-compute[75307]:   <metadata>
Nov 13 23:21:18 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:21:18 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherB-server-619339730</nova:name>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:21:18</nova:creationTime>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:21:18 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:21:18 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:owner>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:user uuid="025c402ce1bc4de7a718a2b5e119b4ae">tempest-ServerActionsTestOtherB-391883818-project-member</nova:user>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:project uuid="9031887798954fab9ea96c7ce9c30984">tempest-ServerActionsTestOtherB-391883818</nova:project>
Nov 13 23:21:18 user nova-compute[75307]:       </nova:owner>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:21:18 user nova-compute[75307]:       <nova:ports>
Nov 13 23:21:18 user nova-compute[75307]:         <nova:port uuid="47e669d9-2897-4d52-8611-36afbf74c293">
Nov 13 23:21:18 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:21:18 user nova-compute[75307]:         </nova:port>
Nov 13 23:21:18 user nova-compute[75307]:       </nova:ports>
Nov 13 23:21:18 user nova-compute[75307]:     </nova:instance>
Nov 13 23:21:18 user nova-compute[75307]:   </metadata>
Nov 13 23:21:18 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:21:18 user nova-compute[75307]:     <system>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="serial">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="uuid">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:21:18 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:21:18 user nova-compute[75307]:     </system>
Nov 13 23:21:18 user nova-compute[75307]:   </sysinfo>
Nov 13 23:21:18 user nova-compute[75307]:   <os>
Nov 13 23:21:18 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:21:18 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:21:18 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:21:18 user nova-compute[75307]:   </os>
Nov 13 23:21:18 user nova-compute[75307]:   <features>
Nov 13 23:21:18 user nova-compute[75307]:     <acpi/>
Nov 13 23:21:18 user nova-compute[75307]:     <apic/>
Nov 13 23:21:18 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:21:18 user nova-compute[75307]:   </features>
Nov 13 23:21:18 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:21:18 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:21:18 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:21:18 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:21:18 user nova-compute[75307]:   </clock>
Nov 13 23:21:18 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:21:18 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:21:18 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:21:18 user nova-compute[75307]:   </cpu>
Nov 13 23:21:18 user nova-compute[75307]:   <devices>
Nov 13 23:21:18 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:21:18 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:21:18 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk"/>
Nov 13 23:21:18 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:21:18 user nova-compute[75307]:     </disk>
Nov 13 23:21:18 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:21:18 user nova-compute[75307]:       <mac address="fa:16:3e:0a:ba:fe"/>
Nov 13 23:21:18 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:21:18 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:21:18 user nova-compute[75307]:       <target dev="tap47e669d9-28"/>
Nov 13 23:21:18 user nova-compute[75307]:     </interface>
Nov 13 23:21:18 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:21:18 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/console.log" append="off"/>
Nov 13 23:21:18 user nova-compute[75307]:     </serial>
Nov 13 23:21:18 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:21:18 user nova-compute[75307]:     <video>
Nov 13 23:21:18 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:21:18 user nova-compute[75307]:     </video>
Nov 13 23:21:18 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:21:18 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:21:18 user nova-compute[75307]:     </rng>
Nov 13 23:21:18 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:21:18 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:21:18 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:21:18 user nova-compute[75307]:     </memballoon>
Nov 13 23:21:18 user nova-compute[75307]:   </devices>
Nov 13 23:21:18 user nova-compute[75307]: </domain>
Nov 13 23:21:18 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:21:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG os_vif [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1118dd7-4706-51ac-96ac-8a93c70820ab', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e669d9-28, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e669d9-28, col_values=(('qos', UUID('61d4dfed-fd10-450e-8e0c-4f00ba2f26a8')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e669d9-28, col_values=(('external_ids', {'iface-id': '47e669d9-2897-4d52-8611-36afbf74c293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:ba:fe', 'vm-uuid': 'a90dad03-c454-4728-a5a6-cf5759a41ed7'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:18 user nova-compute[75307]: INFO os_vif [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No VIF found with MAC fa:16:3e:0a:ba:fe, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updated VIF entry in instance network info cache for port 47e669d9-2897-4d52-8611-36afbf74c293. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8223639e-5489-4c41-82da-c85345700094 req-41981b48-a83d-4271-9bc7-9c871dac0e9a service nova] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:21:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:20 user nova-compute[75307]: WARNING nova.compute.manager [req-dd2ec89c-5da1-439c-a90a-469559d45ed7 req-97871ce8-e888-4e2f-8452-865cfcf20c53 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state building and task_state spawning.
Nov 13 23:21:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:21:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance spawned successfully.
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:21:22 user nova-compute[75307]: INFO nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Took 5.53 seconds to spawn the instance on the hypervisor.
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:22 user nova-compute[75307]: WARNING nova.compute.manager [req-13445503-495c-42c8-8741-672a1b3ca2da req-1245500d-1b85-430a-8be4-c4fd5d7b1851 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state building and task_state spawning.
Nov 13 23:21:22 user nova-compute[75307]: INFO nova.compute.manager [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Took 6.25 seconds to build instance.
Nov 13 23:21:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9d55d00a-547a-4da2-b157-11ccd4c0b489 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:31 user nova-compute[75307]: INFO nova.compute.manager [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Terminating instance
Nov 13 23:21:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-unplugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] No waiting events found dispatching network-vif-unplugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-b623b16d-ca73-4dc9-9d57-e60cc6fba0ae req-14d40f08-80c6-4d43-af47-e32e4a9cb98a service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-unplugged-87cab48e-d481-4b82-a522-805bffe25bd2 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Instance destroyed successfully.
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lazy-loading 'resources' on Instance uuid e6c464b7-a6ae-4f78-9159-5643d52c2295 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-398823675',display_name='tempest-VolumesNegativeTest-instance-398823675',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-398823675',id=19,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:19:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aec709d149343f9a943ff116110c623',ramdisk_id='',reservation_id='r-53pg1574',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-308397641',owner_user_name='tempest-VolumesNegativeTest-308397641-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:19:48Z,user_data=None,user_id='9ea16a187d0247899a6b066823fd098f',uuid=e6c464b7-a6ae-4f78-9159-5643d52c2295,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converting VIF {"id": "87cab48e-d481-4b82-a522-805bffe25bd2", "address": "fa:16:3e:54:10:50", "network": {"id": "ac3cc9bb-cce5-4200-8197-ddd2e756ca0b", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "8deffd35005d4dd285fe42077488177a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87cab48e-d4", "ovs_interfaceid": "87cab48e-d481-4b82-a522-805bffe25bd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG os_vif [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87cab48e-d4, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2aa0e725-e77b-4bc4-b2c9-ecb44ca0276d) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:32 user nova-compute[75307]: INFO os_vif [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:10:50,bridge_name='br-int',has_traffic_filtering=True,id=87cab48e-d481-4b82-a522-805bffe25bd2,network=Network(ac3cc9bb-cce5-4200-8197-ddd2e756ca0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87cab48e-d4')
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Deleting instance files /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295_del
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Deletion of /opt/stack/data/nova/instances/e6c464b7-a6ae-4f78-9159-5643d52c2295_del complete
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.compute.manager [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 13 23:21:32 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Took 0.42 seconds to deallocate network for instance.
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-e4c22cba-cda5-4711-b813-c57938cceab4 req-4790ad0e-8ddb-4639-abfc-97e2abffeed4 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-deleted-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:32 user nova-compute[75307]: INFO nova.compute.manager [req-e4c22cba-cda5-4711-b813-c57938cceab4 req-4790ad0e-8ddb-4639-abfc-97e2abffeed4 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Neutron deleted interface 87cab48e-d481-4b82-a522-805bffe25bd2; detaching it from the instance and deleting it from the info cache
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-e4c22cba-cda5-4711-b813-c57938cceab4 req-4790ad0e-8ddb-4639-abfc-97e2abffeed4 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-e4c22cba-cda5-4711-b813-c57938cceab4 req-4790ad0e-8ddb-4639-abfc-97e2abffeed4 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Detach interface failed, port_id=87cab48e-d481-4b82-a522-805bffe25bd2, reason: Instance e6c464b7-a6ae-4f78-9159-5643d52c2295 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:33 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Deleted allocations for instance e6c464b7-a6ae-4f78-9159-5643d52c2295
Nov 13 23:21:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f8c7593-1951-441a-a234-ec4f19355459 tempest-VolumesNegativeTest-308397641 tempest-VolumesNegativeTest-308397641-project-member] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.815s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] Acquiring lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] Lock "e6c464b7-a6ae-4f78-9159-5643d52c2295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] No waiting events found dispatching network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:33 user nova-compute[75307]: WARNING nova.compute.manager [req-30cfcad1-5dd3-4530-85f8-0a7e9ec6e204 req-5cdb9a97-03d6-4f7a-86e6-0d74c9a6bb76 service nova] [instance: e6c464b7-a6ae-4f78-9159-5643d52c2295] Received unexpected event network-vif-plugged-87cab48e-d481-4b82-a522-805bffe25bd2 for instance with vm_state deleted and task_state None.
Nov 13 23:21:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:44 user nova-compute[75307]: INFO nova.compute.manager [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Terminating instance
Nov 13 23:21:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:21:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-unplugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] No waiting events found dispatching network-vif-unplugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-c9de4857-2392-4ad0-a803-c45ff18ca573 req-d357d490-30c6-4d5a-8228-a28d4e973932 service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-unplugged-b8af2747-4849-4506-8dba-1f948bc07137 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Instance destroyed successfully.
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lazy-loading 'resources' on Instance uuid d2b088e1-c3d9-4f82-86ef-a24cdaecff1c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2016176540',display_name='tempest-TestVolumeSwap-server-2016176540',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2016176540',id=17,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwtbX7B8oozunNJs9j7wOj6qm93UWthDgZe08lpeUdaz/tTVlactjVE6t2YSCcLvTTBnTnMhPlTGyHnI4KUzFGm57bcdfdPp7UJZV+dAL76eDg3v6YJwwXafv8N0tx/jQ==',key_name='tempest-keypair-1111887680',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:18:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62ce44d5d8bb48d5a53bdd99da3cd17b',ramdisk_id='',reservation_id='r-3yo0t0o9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-292329471',owner_user_name='tempest-TestVolumeSwap-292329471-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:18:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='56e0ac93206e4f3497436adad95919ff',uuid=d2b088e1-c3d9-4f82-86ef-a24cdaecff1c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converting VIF {"id": "b8af2747-4849-4506-8dba-1f948bc07137", "address": "fa:16:3e:d9:10:e0", "network": {"id": "00f63fb7-a702-47f7-8163-719eb2cad73b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-304533754-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62ce44d5d8bb48d5a53bdd99da3cd17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8af2747-48", "ovs_interfaceid": "b8af2747-4849-4506-8dba-1f948bc07137", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG os_vif [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8af2747-48, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4564e21f-088f-49b4-9820-71ad55dfc1d8) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:45 user nova-compute[75307]: INFO os_vif [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:10:e0,bridge_name='br-int',has_traffic_filtering=True,id=b8af2747-4849-4506-8dba-1f948bc07137,network=Network(00f63fb7-a702-47f7-8163-719eb2cad73b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8af2747-48')
Nov 13 23:21:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Deleting instance files /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c_del
Nov 13 23:21:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Deletion of /opt/stack/data/nova/instances/d2b088e1-c3d9-4f82-86ef-a24cdaecff1c_del complete
Nov 13 23:21:45 user nova-compute[75307]: INFO nova.compute.manager [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 23:21:45 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:21:45 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:21:46 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:47 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Took 1.17 seconds to deallocate network for instance.
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Acquiring lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] No waiting events found dispatching network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:47 user nova-compute[75307]: WARNING nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received unexpected event network-vif-plugged-b8af2747-4849-4506-8dba-1f948bc07137 for instance with vm_state deleted and task_state None.
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-changed-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Refreshing instance network info cache due to event network-changed-986fd54a-b4ec-4e9f-ae09-25dc147be28c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Acquiring lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Acquired lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Refreshing network info cache for port 986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:47 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Deleted allocations for instance d2b088e1-c3d9-4f82-86ef-a24cdaecff1c
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e347bf50-b03b-439e-832e-3e6b5e829fc7 tempest-TestVolumeSwap-292329471 tempest-TestVolumeSwap-292329471-project-member] Lock "d2b088e1-c3d9-4f82-86ef-a24cdaecff1c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.628s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:47 user nova-compute[75307]: INFO nova.compute.manager [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Terminating instance
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updated VIF entry in instance network info cache for port 986fd54a-b4ec-4e9f-ae09-25dc147be28c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updating instance_info_cache with network_info: [{"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] Releasing lock "refresh_cache-e7eb8413-a53f-45bd-9043-54f23c1c1e10" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ff52344-7b2e-4385-b8db-5455c44f737e req-12f8bd25-2d23-49ce-98cd-eb1ebab453ff service nova] [instance: d2b088e1-c3d9-4f82-86ef-a24cdaecff1c] Received event network-vif-deleted-b8af2747-4849-4506-8dba-1f948bc07137 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-unplugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] No waiting events found dispatching network-vif-unplugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-48a1fa91-3e6c-4e3b-a672-011020859cd8 req-556bc8fa-6cc7-443d-8c67-9d4cfe6876a4 service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-unplugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:21:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Instance destroyed successfully.
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid e7eb8413-a53f-45bd-9043-54f23c1c1e10 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-866801844',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-866801844',id=20,image_ref='51259063-ea79-45f7-9ef9-eea57202ada9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE7G4visRKG841WlVYu5siZ4oXYGOkCE6iLt9nt6DrlPmfJv7/S/SZd7g3DgAuy+4Sd2Mnxjrg9VdQt8cCRk2AqgYr0hTGbX7GrOHK0CPId6hyzkzmYveq1SLazYOFWTYg==',key_name='tempest-keypair-1403696912',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-spsu4m7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-234629115',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:20:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=e7eb8413-a53f-45bd-9043-54f23c1c1e10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "address": "fa:16:3e:81:cb:b1", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap986fd54a-b4", "ovs_interfaceid": "986fd54a-b4ec-4e9f-ae09-25dc147be28c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_vif [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap986fd54a-b4, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=263658f9-0963-4ae7-8ff5-eaaaab7bc126) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:48 user nova-compute[75307]: INFO os_vif [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:cb:b1,bridge_name='br-int',has_traffic_filtering=True,id=986fd54a-b4ec-4e9f-ae09-25dc147be28c,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap986fd54a-b4')
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zLwmXNDI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:21:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c9fea3-6a96-4c52-a549-0d290eb830af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:21:48 user nova-compute[75307]: No targets found.
Nov 13 23:21:48 user nova-compute[75307]: iSNS:
Nov 13 23:21:48 user nova-compute[75307]: No targets found.
Nov 13 23:21:48 user nova-compute[75307]: STATIC:
Nov 13 23:21:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8
Nov 13 23:21:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:21:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:21:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:21:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:21:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:21:48 user nova-compute[75307]: FIRMWARE:
Nov 13 23:21:48 user nova-compute[75307]: No targets found.
Nov 13 23:21:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:21:48 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:21:48 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0290e-1378-4c8c-a8b3-d57f3ac4d5fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c98342e-ed7f-4c46-bdb9-ec38744be70c]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:21:48 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:21:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:21:48 user nova-compute[75307]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 (non-flash)
Nov 13 23:21:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c3f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[87faea26-1c52-4471-ad64-96f7008e008e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d2ccbe-927d-487f-b140-a11be3d3c1a0]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f54a628-0ba8-44dd-bbf0-501a707b018c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[59602d7c-1fc2-40f3-a3d8-c656d797dc5e]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c52e9-ba49-43ef-a864-5dbdae34ec25]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9e6aa9-7f22-4e78-8310-eea51ed682b3]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260]
Nov 13 23:21:48 user nova-compute[75307]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8, portal: 172.16.0.220,3260] successful.
Nov 13 23:21:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:094fc17c-acc8-4649-a44b-5931f08dc4b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4811fa-816a-45cc-90f8-9c513156ffc8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (311ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:21:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Deleting instance files /opt/stack/data/nova/instances/e7eb8413-a53f-45bd-9043-54f23c1c1e10_del
Nov 13 23:21:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Deletion of /opt/stack/data/nova/instances/e7eb8413-a53f-45bd-9043-54f23c1c1e10_del complete
Nov 13 23:21:48 user nova-compute[75307]: INFO nova.compute.manager [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 13 23:21:48 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:21:48 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:21:49 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Took 0.92 seconds to deallocate network for instance.
Nov 13 23:21:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-49835068-fb8d-40d9-957b-29ebd4b827e8 req-4bd0b1f4-6e7c-42d6-9010-ee7f98ccb8da service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-deleted-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] Acquiring lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] No waiting events found dispatching network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:21:49 user nova-compute[75307]: WARNING nova.compute.manager [req-8d5f9244-6e46-4282-b5c9-4e39dc5fa863 req-ca240342-bfdd-41a6-98d7-13f7c790afdb service nova] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Received unexpected event network-vif-plugged-986fd54a-b4ec-4e9f-ae09-25dc147be28c for instance with vm_state active and task_state deleting.
Nov 13 23:21:50 user nova-compute[75307]: INFO nova.compute.manager [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 23:21:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: e7eb8413-a53f-45bd-9043-54f23c1c1e10] Deleting volume: 094fc17c-acc8-4649-a44b-5931f08dc4b8 {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:21:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:21:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:21:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:50 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance e7eb8413-a53f-45bd-9043-54f23c1c1e10
Nov 13 23:21:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0dd1d536-c42c-490c-bbdd-a59dcc10c23d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "e7eb8413-a53f-45bd-9043-54f23c1c1e10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.423s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'flavor' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:21:58 user nova-compute[75307]: INFO nova.compute.manager [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attaching volume 70d9cf58-3652-4ef6-9707-8523ea18eb04 to /dev/vdb
Nov 13 23:21:58 user nova-compute[75307]: DEBUG os_brick.utils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a8166d-6ebc-4644-af1e-10d5bab193a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50ef55b-aba1-4f25-8eeb-7b7229ed59ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc68ed01-7464-4196-920d-231afa7be6c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5b73b0-47d1-4b31-a63b-52b4e0db4876]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:21:59 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:21:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7915b42f-f9c1-4cc4-848f-74fced43d00c]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG os_brick.utils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:21:59 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating existing volume attachment record: 298020e0-875a-472b-8c4e-c773bb9b7290 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:22:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received event network-changed-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Refreshing instance network info cache due to event network-changed-2d5bcd47-a6e8-455c-8136-245972dbac84. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] Acquiring lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] Acquired lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Refreshing network info cache for port 2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updated VIF entry in instance network info cache for port 2d5bcd47-a6e8-455c-8136-245972dbac84. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating instance_info_cache with network_info: [{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ae1a61e-c842-4444-8b99-235b7e896ae1 req-b3235438-d7a1-434b-9303-4f106923daff service nova] Releasing lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:03 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:03 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:03 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[90730c24-ed85-46c2-9ed0-afcfc8df21e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:22:03 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41669f2-0b8c-4c3c-87b7-77ade56c4388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04] added
Nov 13 23:22:03 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dae66b-edda-4b9d-b506-d1607ab296f1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3efa21f1-3098-491a-a4b0-6857f5acbb1f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoqhLCQr {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoqhLCQr" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2608ae7f-d16a-4c2d-abf5-ced3f45aec2c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DoqhLCQr'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd47e8f-601d-45a3-9679-81f75a7a8501]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fae936-963e-439e-a6dd-66eb72e4a63d]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfdf12a-dd50-4b40-943c-24516dd9ef2f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260]
Nov 13 23:22:04 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260] successful.
Nov 13 23:22:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b0cabd-e903-43da-9dde-26acfbbd9e29]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[29987dfd-33b7-45bf-8daf-5d9e728c4ba6]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:04 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:04 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc3a9f3-439b-4f72-a497-602d5a8059e3]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:04 user nova-compute[75307]: INFO nova.compute.manager [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attaching volume b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 to /dev/vdb
Nov 13 23:22:04 user nova-compute[75307]: DEBUG os_brick.utils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbdcae3-b2f0-48a4-bdd5-a1499e812064]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9346439c-a301-488e-9b66-4ea840d0358f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42101eeb-e40e-4ad1-8486-7bef0055713f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ff1ce-b11f-445e-b763-9f3538691df1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:22:05 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:22:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cc556-a78d-412a-99e1-8aa8b1a607e5]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.utils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating existing volume attachment record: 3043b2cf-bf30-464c-a463-ef634d3a894a {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26634616339663633', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634616339663633', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'flavor' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:22:05 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:22:05 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:22:05 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:22:05 user nova-compute[75307]:   <serial>70d9cf58-3652-4ef6-9707-8523ea18eb04</serial>
Nov 13 23:22:05 user nova-compute[75307]: </disk>
Nov 13 23:22:05 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No VIF found with MAC fa:16:3e:fa:1a:ce, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-70990b51-a243-4e8d-9421-78ed4c840e1b tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.869s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:22:06 user nova-compute[75307]: INFO nova.compute.manager [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Rescuing
Nov 13 23:22:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:06 user nova-compute[75307]: DEBUG nova.network.neutron [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'info_cache' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:07 user nova-compute[75307]: WARNING nova.compute.manager [req-c04c2da3-cdfe-4dd2-b3c2-0f750431f777 req-92a95609-8c2e-41a1-bbad-20b6d1f5d1a5 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state active and task_state rescuing.
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance destroyed successfully.
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'resources' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG os_vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6511cea-1a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c566a2a-08d5-4391-9bf0-c8ccb2ce1270) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:08 user nova-compute[75307]: INFO os_vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start _get_guest_xml network_info=[{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'numa_topology' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance destroyed successfully.
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attempting a stable device rescue
Nov 13 23:22:08 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:08 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:22:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Creating image(s)
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'trusted_certs' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:08 user nova-compute[75307]:   <uuid>fdc18eac-a300-4f89-8621-2075decfec01</uuid>
Nov 13 23:22:08 user nova-compute[75307]:   <name>instance-00000004</name>
Nov 13 23:22:08 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:08 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:08 user nova-compute[75307]:   <metadata>
Nov 13 23:22:08 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:08 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeTestJSON-server-15052950</nova:name>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:08</nova:creationTime>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:08 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:08 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:user uuid="19d8c9bb553d4995bc62521ef2b8bf0b">tempest-AttachVolumeTestJSON-1230084994-project-member</nova:user>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:project uuid="e387a1f37b944329bb8f097e8f4ec56b">tempest-AttachVolumeTestJSON-1230084994</nova:project>
Nov 13 23:22:08 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:08 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:08 user nova-compute[75307]:         <nova:port uuid="d6511cea-1a73-4612-bd4b-5a50bd96a3b1">
Nov 13 23:22:08 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 23:22:08 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:08 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:08 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:08 user nova-compute[75307]:   </metadata>
Nov 13 23:22:08 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:08 user nova-compute[75307]:     <system>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="serial">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="uuid">fdc18eac-a300-4f89-8621-2075decfec01</entry>
Nov 13 23:22:08 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:08 user nova-compute[75307]:     </system>
Nov 13 23:22:08 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:08 user nova-compute[75307]:   <os>
Nov 13 23:22:08 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:08 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:22:08 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:08 user nova-compute[75307]:   </os>
Nov 13 23:22:08 user nova-compute[75307]:   <features>
Nov 13 23:22:08 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:08 user nova-compute[75307]:     <apic/>
Nov 13 23:22:08 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:08 user nova-compute[75307]:   </features>
Nov 13 23:22:08 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:08 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:08 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:08 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:08 user nova-compute[75307]:   </clock>
Nov 13 23:22:08 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:08 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:08 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:08 user nova-compute[75307]:   </cpu>
Nov 13 23:22:08 user nova-compute[75307]:   <devices>
Nov 13 23:22:08 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:08 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:08 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk"/>
Nov 13 23:22:08 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:08 user nova-compute[75307]:     </disk>
Nov 13 23:22:08 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:08 user nova-compute[75307]:       <mac address="fa:16:3e:7a:10:97"/>
Nov 13 23:22:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:08 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:08 user nova-compute[75307]:       <target dev="tapd6511cea-1a"/>
Nov 13 23:22:08 user nova-compute[75307]:     </interface>
Nov 13 23:22:08 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:08 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/console.log" append="off"/>
Nov 13 23:22:08 user nova-compute[75307]:     </serial>
Nov 13 23:22:08 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:08 user nova-compute[75307]:     <video>
Nov 13 23:22:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:08 user nova-compute[75307]:     </video>
Nov 13 23:22:08 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:08 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:08 user nova-compute[75307]:     </rng>
Nov 13 23:22:08 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:08 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:08 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:08 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:08 user nova-compute[75307]:   </devices>
Nov 13 23:22:08 user nova-compute[75307]: </domain>
Nov 13 23:22:08 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 1.096s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHpUxYuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:09 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:09 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:09 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.virt.images [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] 6c341d14-245c-4182-93e1-712b2aa58309 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.part /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc5f08c-5fe2-4d88-b691-a86f76d447f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:22:09 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be847c68-69da-4dfc-a379-28b21a9d1372]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98] added
Nov 13 23:22:09 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff38e4-3cb2-4693-a016-f446d83fe543]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.133s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[30133914-1946-4596-9778-fc31baaffa6f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHpUxYuv {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bHpUxYuv" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6459859-1c23-4dfb-9ab8-61ac2b00380e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bHpUxYuv'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f1606-7f97-4e66-8aeb-db321d401c74]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc18af7-96be-4a39-a4eb-e4c9da488181]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.part /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.converted" returned: 0 in 0.385s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[39abfd1e-2ec9-407b-8eb4-535ed7d0b0ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260]
Nov 13 23:22:10 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260] successful.
Nov 13 23:22:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Cannot resize image /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'migration_context' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Object Instance<fdc18eac-a300-4f89-8621-2075decfec01> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:20:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f57638a-8694-45c3-b32c-a3dbd5c194f3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c85ed381-5f23-5e82-8706-361ec19d4164', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6852f632-9639-49fd-9bb6-6c44b5168df8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.535s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6511cea-1a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd6511cea-1a, col_values=(('qos', UUID('bac6fa04-17b1-40f3-8375-71cdd33514f1')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd6511cea-1a, col_values=(('external_ids', {'iface-id': 'd6511cea-1a73-4612-bd4b-5a50bd96a3b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:10:97', 'vm-uuid': 'fdc18eac-a300-4f89-8621-2075decfec01'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630235f-a24b-4c8a-bba8-ef70c42f1ce5]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHpUxYuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: INFO os_vif [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.812s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b,backing_fmt=raw /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:10 user nova-compute[75307]: WARNING nova.compute.manager [req-1ee095d6-aba2-4702-8057-224becb58fba req-9a8b1079-ceb5-4105-97e2-ad614511a34c service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state active and task_state rescuing.
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b,backing_fmt=raw /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue" returned: 0 in 0.050s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "12fc4686594eec7200485ffa14d7ab175eea6a2b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'migration_context' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Object Instance<c6b7203a-cce3-452a-9002-10011310b3e2> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start _get_guest_xml network_info=[{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "vif_mac": "fa:16:3e:fa:1a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '6c341d14-245c-4182-93e1-712b2aa58309', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'c6b7203a-cce3-452a-9002-10011310b3e2', 'attached_at': '', 'detached_at': '', 'volume_id': '70d9cf58-3652-4ef6-9707-8523ea18eb04', 'serial': '70d9cf58-3652-4ef6-9707-8523ea18eb04'}, 'delete_on_termination': False, 'attachment_id': '298020e0-875a-472b-8c4e-c773bb9b7290', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'resources' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Object Instance<c6b7203a-cce3-452a-9002-10011310b3e2> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'numa_topology' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Object Instance<c6b7203a-cce3-452a-9002-10011310b3e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'vcpu_model' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Object Instance<c6b7203a-cce3-452a-9002-10011310b3e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:10 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.610s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== connect_volume: return (1616ms) {'type': 'block', 'scsi_wwn': '23138643938643863', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138643938643863', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.655s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:11 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:11 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21645c4-2743-4b38-ae4e-ffa70400c940]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DoqhLCQr\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 23:22:11 user nova-compute[75307]: node.name = iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:22:11 user nova-compute[75307]: node.tpgt = -1
Nov 13 23:22:11 user nova-compute[75307]: node.startup = automatic
Nov 13 23:22:11 user nova-compute[75307]: node.leading_login = No
Nov 13 23:22:11 user nova-compute[75307]: iface.iscsi_ifacename = default
Nov 13 23:22:11 user nova-compute[75307]: iface.net_ifacename = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.ipaddress = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.prefix_len = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.hwaddress = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.transport_name = tcp
Nov 13 23:22:11 user nova-compute[75307]: iface.initiatorname = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.vlan_id = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.vlan_priority = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.vlan_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.iface_num = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.mtu = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.port = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.bootproto = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.subnet_mask = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.gateway = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_alt_client_id = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_dns = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_learn_iqn = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_vendor_id_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_vendor_id = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.dhcp_slp_da = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.fragmentation = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.gratuitous_arp = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.incoming_forwarding = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.tos_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.tos = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.ttl = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.delayed_ack = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.tcp_nagle = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.tcp_wsf_state = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.tcp_wsf = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.tcp_timer_scale = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.tcp_timestamp = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.redirect = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.def_task_mgmt_timeout = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.header_digest = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.data_digest = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.immediate_data = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.initial_r2t = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.data_seq_inorder = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.data_pdu_inorder = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.erl = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.max_receive_data_len = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.first_burst_len = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.max_outstanding_r2t = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.max_burst_len = 0
Nov 13 23:22:11 user nova-compute[75307]: iface.chap_auth = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.bidi_chap = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.strict_login_compliance = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.discovery_auth = <empty>
Nov 13 23:22:11 user nova-compute[75307]: iface.discovery_logout = <empty>
Nov 13 23:22:11 user nova-compute[75307]: node.discovery_address = <empty>
Nov 13 23:22:11 user nova-compute[75307]: node.discovery_port = 0
Nov 13 23:22:11 user nova-compute[75307]: node.discovery_type = static
Nov 13 23:22:11 user nova-compute[75307]: node.session.initial_cmdsn = 0
Nov 13 23:22:11 user nova-compute[75307]: node.session.initial_login_retry_max = 8
Nov 13 23:22:11 user nova-compute[75307]: node.session.xmit_thread_priority = -20
Nov 13 23:22:11 user nova-compute[75307]: node.session.cmds_max = 128
Nov 13 23:22:11 user nova-compute[75307]: node.session.queue_depth = 32
Nov 13 23:22:11 user nova-compute[75307]: node.session.nr_sessions = 1
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.authmethod = CHAP
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.username = DoqhLCQr
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.password = ***
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.username_in = <empty>
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.password_in = <empty>
Nov 13 23:22:11 user nova-compute[75307]: node.session.auth.chap_algs = MD5
Nov 13 23:22:11 user nova-compute[75307]: node.session.timeo.replacement_timeout = 120
Nov 13 23:22:11 user nova-compute[75307]: node.session.err_timeo.abort_timeout = 15
Nov 13 23:22:11 user nova-compute[75307]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 23:22:11 user nova-compute[75307]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 23:22:11 user nova-compute[75307]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.FastAbort = Yes
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.InitialR2T = No
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.ImmediateData = Yes
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.MaxConnections = 1
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 23:22:11 user nova-compute[75307]: node.session.iscsi.ERL = 0
Nov 13 23:22:11 user nova-compute[75307]: node.session.scan = manual
Nov 13 23:22:11 user nova-compute[75307]: node.session.reopen_max = 0
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].address = 172.16.0.220
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].port = 3260
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].startup = manual
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].tcp.window_size = 524288
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].tcp.type_of_service = 0
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].timeo.logout_timeout = 15
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].timeo.login_timeout = 15
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].timeo.auth_timeout = 45
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.DataDigest = None
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.IFMarker = No
Nov 13 23:22:11 user nova-compute[75307]: node.conn[0].iscsi.OFMarker = No
Nov 13 23:22:11 user nova-compute[75307]: # END RECORD
Nov 13 23:22:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:22:11 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:22:11 user nova-compute[75307]:   <source dev="/dev/sdd"/>
Nov 13 23:22:11 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:   <serial>b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98</serial>
Nov 13 23:22:11 user nova-compute[75307]: </disk>
Nov 13 23:22:11 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561c1d4-be6f-4083-b089-0cca977f0c88]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85652883-76ed-4543-b0fa-51156cd67d8e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoqhLCQr {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DoqhLCQr" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b282f2c2-b98d-420c-9cf3-82a8ee3bd6de]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DoqhLCQr'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[767efa12-dbfd-422b-9c35-eb8b6cd4d3d5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c44b758-257e-4176-81fb-4537b6cba704]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:11 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:11 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:11 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:11 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.212s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] HCTL ('33', '0', '0', 0) found on session 25 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac254c6-ee8a-4662-b881-f45fc6ae3fed]: (4, ('0 0 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Searching for a device in session 25 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.240s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] <== connect_volume: return (895ms) {'type': 'block', 'scsi_wwn': '26634616339663633', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634616339663633', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1092360754',display_name='tempest-ServerStableDeviceRescueTest-server-1092360754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1092360754',id=15,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO1CcKJSxuglMb7gdJ5JBc1gv7mrL0AV9DJCjmp/3v0oY+d9hMUoCvALlkJk0hLvSY8DI1HjcDiIQiUH75CDilOfY7kn9V5A2Irk9in+iVma9dnsMUlICdGug0s/BtaOQ==',key_name='tempest-keypair-315055213',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:18:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec4693b70f449ae8aec526a751ceda8',ramdisk_id='',reservation_id='r-h936wvew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-236265535',owner_user_name='tempest-ServerStableDeviceRescueTest-236265535-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:20:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad50de29ef84625a9b23c295d97484d',uuid=c6b7203a-cce3-452a-9002-10011310b3e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "vif_mac": "fa:16:3e:fa:1a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converting VIF {"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "vif_mac": "fa:16:3e:fa:1a:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.objects.instance [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'pci_devices' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.objects.base [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Object Instance<c6b7203a-cce3-452a-9002-10011310b3e2> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:11 user nova-compute[75307]:   <uuid>c6b7203a-cce3-452a-9002-10011310b3e2</uuid>
Nov 13 23:22:11 user nova-compute[75307]:   <name>instance-0000000f</name>
Nov 13 23:22:11 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:11 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:11 user nova-compute[75307]:   <metadata>
Nov 13 23:22:11 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:11 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1092360754</nova:name>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:10</nova:creationTime>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:11 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:11 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:user uuid="0ad50de29ef84625a9b23c295d97484d">tempest-ServerStableDeviceRescueTest-236265535-project-member</nova:user>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:project uuid="1ec4693b70f449ae8aec526a751ceda8">tempest-ServerStableDeviceRescueTest-236265535</nova:project>
Nov 13 23:22:11 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:11 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:11 user nova-compute[75307]:         <nova:port uuid="a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b">
Nov 13 23:22:11 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:22:11 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:11 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:11 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:11 user nova-compute[75307]:   </metadata>
Nov 13 23:22:11 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:11 user nova-compute[75307]:     <system>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="serial">c6b7203a-cce3-452a-9002-10011310b3e2</entry>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="uuid">c6b7203a-cce3-452a-9002-10011310b3e2</entry>
Nov 13 23:22:11 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:11 user nova-compute[75307]:     </system>
Nov 13 23:22:11 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:11 user nova-compute[75307]:   <os>
Nov 13 23:22:11 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:11 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:11 user nova-compute[75307]:   </os>
Nov 13 23:22:11 user nova-compute[75307]:   <features>
Nov 13 23:22:11 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:11 user nova-compute[75307]:     <apic/>
Nov 13 23:22:11 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:11 user nova-compute[75307]:   </features>
Nov 13 23:22:11 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:11 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:11 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:11 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:11 user nova-compute[75307]:   </clock>
Nov 13 23:22:11 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:11 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:11 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:11 user nova-compute[75307]:   </cpu>
Nov 13 23:22:11 user nova-compute[75307]:   <devices>
Nov 13 23:22:11 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:11 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:11 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk"/>
Nov 13 23:22:11 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:     </disk>
Nov 13 23:22:11 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:22:11 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:22:11 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:22:11 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:       <serial>70d9cf58-3652-4ef6-9707-8523ea18eb04</serial>
Nov 13 23:22:11 user nova-compute[75307]:     </disk>
Nov 13 23:22:11 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:11 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:11 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue"/>
Nov 13 23:22:11 user nova-compute[75307]:       <target dev="vdc" bus="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:       <boot order="1"/>
Nov 13 23:22:11 user nova-compute[75307]:     </disk>
Nov 13 23:22:11 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:11 user nova-compute[75307]:       <mac address="fa:16:3e:fa:1a:ce"/>
Nov 13 23:22:11 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:11 user nova-compute[75307]:       <target dev="tapa0a7006d-5f"/>
Nov 13 23:22:11 user nova-compute[75307]:     </interface>
Nov 13 23:22:11 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:11 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/console.log" append="off"/>
Nov 13 23:22:11 user nova-compute[75307]:     </serial>
Nov 13 23:22:11 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:11 user nova-compute[75307]:     <video>
Nov 13 23:22:11 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:11 user nova-compute[75307]:     </video>
Nov 13 23:22:11 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:11 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:11 user nova-compute[75307]:     </rng>
Nov 13 23:22:11 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:11 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:11 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:11 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:11 user nova-compute[75307]:   </devices>
Nov 13 23:22:11 user nova-compute[75307]: </domain>
Nov 13 23:22:11 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance destroyed successfully.
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] No VIF found with MAC fa:16:3e:fa:1a:ce, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:11 user nova-compute[75307]: WARNING nova.compute.manager [req-c8e1697c-e5b0-4215-b4da-bde8d59f6351 req-bbfac4c4-0b32-4ab7-91da-beb0854c6c2d service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state powering-on.
Nov 13 23:22:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No VIF found with MAC fa:16:3e:80:4b:90, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7845e321-8ad0-4c30-99be-5f2f52b368e3 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.423s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:15 user nova-compute[75307]: WARNING nova.compute.manager [req-27e1b039-21cc-4b69-b24a-cc342b1f022e req-2eb5054f-91b1-46fe-aeed-623265b9a3ca service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state stopped and task_state powering-on.
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:15 user nova-compute[75307]: WARNING nova.compute.manager [req-3b78e475-0948-4298-933c-0fd8e5fad40f req-fdd5b78c-b4a3-4c2b-9d0c-68ff2da85e68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state active and task_state rescuing.
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:22:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7893MB free_disk=25.43021011352539GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance rebooted successfully.
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-563b7cfe-d333-4d73-9401-0c7702a6dc20 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:16 user nova-compute[75307]: WARNING nova.compute.manager [req-7a68811c-e9b4-45bb-b34a-a4d169c8eb6f req-b6c9fcd7-b37e-4c7a-b2c2-c3eadec51b35 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state active and task_state rescuing.
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-96eaad46-5a6e-4ddc-b67a-7eebbc32f345 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:22:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:22:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:20 user nova-compute[75307]: INFO nova.compute.manager [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Detaching volume b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98
Nov 13 23:22:20 user nova-compute[75307]: INFO nova.virt.block_device [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attempting to driver detach volume b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 from mountpoint /dev/vdb
Nov 13 23:22:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Attempting to detach device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:22:20 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:22:20 user nova-compute[75307]:   <source dev="/dev/sdd"/>
Nov 13 23:22:20 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:22:20 user nova-compute[75307]:   <serial>b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98</serial>
Nov 13 23:22:20 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:22:20 user nova-compute[75307]: </disk>
Nov 13 23:22:20 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:22:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config.
Nov 13 23:22:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:22:20 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:22:20 user nova-compute[75307]:   <source dev="/dev/sdd"/>
Nov 13 23:22:20 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:22:20 user nova-compute[75307]:   <serial>b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98</serial>
Nov 13 23:22:20 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:22:20 user nova-compute[75307]: </disk>
Nov 13 23:22:20 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:22:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:22:30 user nova-compute[75307]: INFO nova.compute.claims [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Claim successful on node user
Nov 13 23:22:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:22:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.policy [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '519cf74c92b9446a9c644f45f3909253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:22:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Creating image(s)
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "/opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "/opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk 1073741824" returned: 0 in 0.054s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Successfully created port: 7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Cannot resize image /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Ensure instance console log exists: /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Successfully updated port: 7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquired lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing instance network info cache due to event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] Acquiring lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating instance_info_cache with network_info: [{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Releasing lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Instance network_info: |[{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] Acquired lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.neutron [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Start _get_guest_xml network_info=[{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:33 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:33 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-311642129',display_name='tempest-TestStampPattern-server-311642129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-311642129',id=23,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-p8sz8sjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:31Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=f6233ac6-5054-48b9-94cf-607e2b2b28e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'pci_devices' on Instance uuid f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:33 user nova-compute[75307]:   <uuid>f6233ac6-5054-48b9-94cf-607e2b2b28e9</uuid>
Nov 13 23:22:33 user nova-compute[75307]:   <name>instance-00000017</name>
Nov 13 23:22:33 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:33 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:33 user nova-compute[75307]:   <metadata>
Nov 13 23:22:33 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:33 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:name>tempest-TestStampPattern-server-311642129</nova:name>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:33</nova:creationTime>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:33 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:33 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:user uuid="519cf74c92b9446a9c644f45f3909253">tempest-TestStampPattern-1908061242-project-member</nova:user>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:project uuid="3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb">tempest-TestStampPattern-1908061242</nova:project>
Nov 13 23:22:33 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:33 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:33 user nova-compute[75307]:         <nova:port uuid="7a6461d6-ca33-4f59-81d5-4068de92f6c8">
Nov 13 23:22:33 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:22:33 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:33 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:33 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:33 user nova-compute[75307]:   </metadata>
Nov 13 23:22:33 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:33 user nova-compute[75307]:     <system>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="serial">f6233ac6-5054-48b9-94cf-607e2b2b28e9</entry>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="uuid">f6233ac6-5054-48b9-94cf-607e2b2b28e9</entry>
Nov 13 23:22:33 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:33 user nova-compute[75307]:     </system>
Nov 13 23:22:33 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:33 user nova-compute[75307]:   <os>
Nov 13 23:22:33 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:33 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:22:33 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:33 user nova-compute[75307]:   </os>
Nov 13 23:22:33 user nova-compute[75307]:   <features>
Nov 13 23:22:33 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:33 user nova-compute[75307]:     <apic/>
Nov 13 23:22:33 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:33 user nova-compute[75307]:   </features>
Nov 13 23:22:33 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:33 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:33 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:33 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:33 user nova-compute[75307]:   </clock>
Nov 13 23:22:33 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:33 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:33 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:33 user nova-compute[75307]:   </cpu>
Nov 13 23:22:33 user nova-compute[75307]:   <devices>
Nov 13 23:22:33 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:33 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:33 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk"/>
Nov 13 23:22:33 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:33 user nova-compute[75307]:     </disk>
Nov 13 23:22:33 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:33 user nova-compute[75307]:       <mac address="fa:16:3e:a6:57:36"/>
Nov 13 23:22:33 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:33 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:33 user nova-compute[75307]:       <target dev="tap7a6461d6-ca"/>
Nov 13 23:22:33 user nova-compute[75307]:     </interface>
Nov 13 23:22:33 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:33 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/console.log" append="off"/>
Nov 13 23:22:33 user nova-compute[75307]:     </serial>
Nov 13 23:22:33 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:33 user nova-compute[75307]:     <video>
Nov 13 23:22:33 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:33 user nova-compute[75307]:     </video>
Nov 13 23:22:33 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:33 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:33 user nova-compute[75307]:     </rng>
Nov 13 23:22:33 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:33 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:33 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:33 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:33 user nova-compute[75307]:   </devices>
Nov 13 23:22:33 user nova-compute[75307]: </domain>
Nov 13 23:22:33 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-311642129',display_name='tempest-TestStampPattern-server-311642129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-311642129',id=23,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-p8sz8sjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:31Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=f6233ac6-5054-48b9-94cf-607e2b2b28e9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG os_vif [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a9a1302-d152-5f09-a2f5-85e980ce4d56', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a6461d6-ca, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a6461d6-ca, col_values=(('qos', UUID('103f71c4-342a-47f5-a74a-07f5f7a4ec95')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a6461d6-ca, col_values=(('external_ids', {'iface-id': '7a6461d6-ca33-4f59-81d5-4068de92f6c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:57:36', 'vm-uuid': 'f6233ac6-5054-48b9-94cf-607e2b2b28e9'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:33 user nova-compute[75307]: INFO os_vif [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca')
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No VIF found with MAC fa:16:3e:a6:57:36, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updated VIF entry in instance network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating instance_info_cache with network_info: [{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-370884ea-0726-40f9-be43-7a64db35eafb req-672e31d9-f4c3-47b0-990d-a57d747aa430 service nova] Releasing lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] No waiting events found dispatching network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:35 user nova-compute[75307]: WARNING nova.compute.manager [req-92555013-e31e-454b-adf5-71dd0ccf5d69 req-45a80f00-b9ec-4f5c-abdc-c373b00355dc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received unexpected event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 for instance with vm_state building and task_state spawning.
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:22:35 user nova-compute[75307]: INFO nova.compute.claims [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Claim successful on node user
Nov 13 23:22:35 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:22:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.policy [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ca0ce44f4d041b5b98883e3796abe32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7260b3ec00fc412091e6db3c55993345', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:22:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Creating image(s)
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.203s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk 1073741824" returned: 0 in 0.049s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:22:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Cannot resize image /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Ensure instance console log exists: /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] No waiting events found dispatching network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:37 user nova-compute[75307]: WARNING nova.compute.manager [req-478bf5f4-d0ef-46c0-a7ee-d4043883308f req-9644ab7e-c978-4ca1-882e-d409af841cfa service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received unexpected event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 for instance with vm_state building and task_state spawning.
Nov 13 23:22:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:22:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Instance spawned successfully.
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:37 user nova-compute[75307]: INFO nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Took 5.79 seconds to spawn the instance on the hypervisor.
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:37 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Successfully created port: 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:22:37 user nova-compute[75307]: INFO nova.compute.manager [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Took 6.66 seconds to build instance.
Nov 13 23:22:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e6fc8c5f-d5f9-4b37-affe-0bdec6d8a544 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.764s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Successfully updated port: 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing instance network info cache due to event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:39 user nova-compute[75307]: INFO nova.compute.manager [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Terminating instance
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance network_info: |[{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.neutron [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start _get_guest_xml network_info=[{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-551549900',display_name='tempest-ServerRescueNegativeTestJSON-server-551549900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-551549900',id=24,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAtqBJtxyMkvcPp7JlAXa+kLS85YNSUkgLrctZnBQ6Ae9TSu8Y6PKws/M+1yXgAOiQdEvLI7C+Q9wLe76rK2SBB/ciJtsrcKfxWhf3vhVPgV+FCvuOtSNQKPU7FgwsQIA==',key_name='tempest-keypair-602851905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-la018wet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=f6a7736a-5973-40cd-8e8e-0404353941c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:39 user nova-compute[75307]:   <uuid>f6a7736a-5973-40cd-8e8e-0404353941c1</uuid>
Nov 13 23:22:39 user nova-compute[75307]:   <name>instance-00000018</name>
Nov 13 23:22:39 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:39 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:39 user nova-compute[75307]:   <metadata>
Nov 13 23:22:39 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:39 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-551549900</nova:name>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:39</nova:creationTime>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:39 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:39 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:22:39 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:39 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:39 user nova-compute[75307]:         <nova:port uuid="4ceb2d7f-b19c-4adc-b4e4-98aed704f613">
Nov 13 23:22:39 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 23:22:39 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:39 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:39 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:39 user nova-compute[75307]:   </metadata>
Nov 13 23:22:39 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:39 user nova-compute[75307]:     <system>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="serial">f6a7736a-5973-40cd-8e8e-0404353941c1</entry>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="uuid">f6a7736a-5973-40cd-8e8e-0404353941c1</entry>
Nov 13 23:22:39 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:39 user nova-compute[75307]:     </system>
Nov 13 23:22:39 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:39 user nova-compute[75307]:   <os>
Nov 13 23:22:39 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:39 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:22:39 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:39 user nova-compute[75307]:   </os>
Nov 13 23:22:39 user nova-compute[75307]:   <features>
Nov 13 23:22:39 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:39 user nova-compute[75307]:     <apic/>
Nov 13 23:22:39 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:39 user nova-compute[75307]:   </features>
Nov 13 23:22:39 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:39 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:39 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:39 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:39 user nova-compute[75307]:   </clock>
Nov 13 23:22:39 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:39 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:39 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:39 user nova-compute[75307]:   </cpu>
Nov 13 23:22:39 user nova-compute[75307]:   <devices>
Nov 13 23:22:39 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:39 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:39 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk"/>
Nov 13 23:22:39 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:39 user nova-compute[75307]:     </disk>
Nov 13 23:22:39 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:39 user nova-compute[75307]:       <mac address="fa:16:3e:f8:75:21"/>
Nov 13 23:22:39 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:39 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:39 user nova-compute[75307]:       <target dev="tap4ceb2d7f-b1"/>
Nov 13 23:22:39 user nova-compute[75307]:     </interface>
Nov 13 23:22:39 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:39 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/console.log" append="off"/>
Nov 13 23:22:39 user nova-compute[75307]:     </serial>
Nov 13 23:22:39 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:39 user nova-compute[75307]:     <video>
Nov 13 23:22:39 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:39 user nova-compute[75307]:     </video>
Nov 13 23:22:39 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:39 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:39 user nova-compute[75307]:     </rng>
Nov 13 23:22:39 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:39 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:39 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:39 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:39 user nova-compute[75307]:   </devices>
Nov 13 23:22:39 user nova-compute[75307]: </domain>
Nov 13 23:22:39 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-551549900',display_name='tempest-ServerRescueNegativeTestJSON-server-551549900',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-551549900',id=24,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAtqBJtxyMkvcPp7JlAXa+kLS85YNSUkgLrctZnBQ6Ae9TSu8Y6PKws/M+1yXgAOiQdEvLI7C+Q9wLe76rK2SBB/ciJtsrcKfxWhf3vhVPgV+FCvuOtSNQKPU7FgwsQIA==',key_name='tempest-keypair-602851905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-la018wet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=f6a7736a-5973-40cd-8e8e-0404353941c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG os_vif [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '54a90eac-41f3-5eb4-a004-7ce6b52accb8', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ceb2d7f-b1, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ceb2d7f-b1, col_values=(('qos', UUID('adc48a2f-edc5-4b19-a03a-749f45d90dc7')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ceb2d7f-b1, col_values=(('external_ids', {'iface-id': '4ceb2d7f-b19c-4adc-b4e4-98aed704f613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:75:21', 'vm-uuid': 'f6a7736a-5973-40cd-8e8e-0404353941c1'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:39 user nova-compute[75307]: INFO os_vif [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1')
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:f8:75:21, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.network.neutron [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updated VIF entry in instance network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.network.neutron [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6a81b236-228e-42d4-ae8b-77fffe4ec63f req-79211fbd-c9f2-484f-8d9d-c97897e6ca2d service nova] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Instance destroyed successfully.
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:17:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2009755200',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2009755200',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCalIwlidrHtfzsLxpRBUQ6l/s7uQaDs2dJseBpVgSx8ViBsfXK2P3DxRZtVmkC6Uo4tZsLoNGVpfNW6VMU5GdzmALQnysHxmjrQHmWg0KF0jFwtdxcEGn7jSkx599XCGQ==',key_name='tempest-keypair-1797345135',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:18:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-os5dk1dr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:18:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "da729a35-f81c-4005-a179-a06292942c86", "address": "fa:16:3e:8a:d2:7b", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda729a35-f8", "ovs_interfaceid": "da729a35-f81c-4005-a179-a06292942c86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_vif [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda729a35-f8, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab23a737-a562-4394-8a8e-5c4fdf013846) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:40 user nova-compute[75307]: INFO os_vif [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:d2:7b,bridge_name='br-int',has_traffic_filtering=True,id=da729a35-f81c-4005-a179-a06292942c86,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda729a35-f8')
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRkPypDV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:40 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae23f3d-7e30-41c1-94b8-fea415c23eb0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:22:40 user nova-compute[75307]: No targets found.
Nov 13 23:22:40 user nova-compute[75307]: iSNS:
Nov 13 23:22:40 user nova-compute[75307]: No targets found.
Nov 13 23:22:40 user nova-compute[75307]: STATIC:
Nov 13 23:22:40 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98
Nov 13 23:22:40 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:22:40 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:22:40 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:22:40 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:22:40 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:22:40 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d
Nov 13 23:22:40 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:22:40 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:22:40 user nova-compute[75307]: FIRMWARE:
Nov 13 23:22:40 user nova-compute[75307]: No targets found.
Nov 13 23:22:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:22:40 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:22:40 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8195e306-d7cd-4bb0-acde-c69acade091a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e840755-ff2b-47d0-afa6-cef40bd2f5c8]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:40 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:40 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d (non-flash)
Nov 13 23:22:40 user nova-compute[75307]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:40 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c119d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae13a525-159a-4975-95c0-e7784784ba0d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 is timed out.
Nov 13 23:22:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config.
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bHpUxYuv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:22:40 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d6f721-0611-48b7-9fa0-82c95a9b613b]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ebb7068-548c-4765-a449-d2562f1cffc8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-unplugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] No waiting events found dispatching network-vif-unplugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-unplugged-da729a35-f81c-4005-a179-a06292942c86 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Acquiring lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] No waiting events found dispatching network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:40 user nova-compute[75307]: WARNING nova.compute.manager [req-6b3a8c27-3f50-494d-8aaa-d25d79b4401d req-21f0ef62-9aa3-43c3-b404-be465f20d7a1 service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received unexpected event network-vif-plugged-da729a35-f81c-4005-a179-a06292942c86 for instance with vm_state active and task_state deleting.
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[114d0a8a-6e45-417d-a8a0-b19f6b7ed991]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaedcec2-1507-4117-b408-7cd15cf89f0a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73542430-0cff-4666-8185-8466f0a57ea5]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260]
Nov 13 23:22:41 user nova-compute[75307]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d, portal: 172.16.0.220,3260] successful.
Nov 13 23:22:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d69a3ef-fd1f-4d95-87b6-abfada00d66d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48878fe9-cbf8-4da0-a0c0-f3a05143ca77]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (368ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:22:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Deleting instance files /opt/stack/data/nova/instances/d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb_del
Nov 13 23:22:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Deletion of /opt/stack/data/nova/instances/d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb_del complete
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.228s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb702e5-6daf-4ecd-b4b0-c910adbfb47b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:22:41 user nova-compute[75307]: No targets found.
Nov 13 23:22:41 user nova-compute[75307]: iSNS:
Nov 13 23:22:41 user nova-compute[75307]: No targets found.
Nov 13 23:22:41 user nova-compute[75307]: STATIC:
Nov 13 23:22:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98
Nov 13 23:22:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:22:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:22:41 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:22:41 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:22:41 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:22:41 user nova-compute[75307]: FIRMWARE:
Nov 13 23:22:41 user nova-compute[75307]: No targets found.
Nov 13 23:22:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:22:41 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:22:41 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7367ef7e-4cbc-4110-bff0-afdf4218fda5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: INFO nova.compute.manager [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46def9b6-c134-4d27-aa75-9296c157124c]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:41 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:22:41 user nova-compute[75307]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 (non-flash)
Nov 13 23:22:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c4d69e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b15d40-d227-4ca3-af0a-99ffe3aa7636]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[806a7837-989f-4699-af54-17476a9738ac]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9be6b31-9424-42de-926d-90a4250deece]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bb8f837-4f14-4127-a5dd-e548aad570af]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f33638-032f-4c45-8206-b0b937611211]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8ff514-f62e-4086-bfe1-0ef9808bba2f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260]
Nov 13 23:22:41 user nova-compute[75307]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98, portal: 172.16.0.220,3260] successful.
Nov 13 23:22:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b72528c3-a0b3-4fe0-8ace-2cdcd6a0aa98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f47fc12-81b9-4cab-9434-38cdf5e28b5b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== disconnect_volume: return (625ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:22:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:42 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Took 1.18 seconds to deallocate network for instance.
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d3743576-5534-4811-9177-3b905bca28d5 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.274s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:42 user nova-compute[75307]: WARNING nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state building and task_state spawning.
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:42 user nova-compute[75307]: WARNING nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state building and task_state spawning.
Nov 13 23:22:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c831d46-56b4-43f9-a7ea-a57a0ccf02ae req-66d18782-2774-45e7-939c-a50b582be4bf service nova] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Received event network-vif-deleted-da729a35-f81c-4005-a179-a06292942c86 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:43 user nova-compute[75307]: INFO nova.compute.manager [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Took 0.94 seconds to detach 1 volumes for instance.
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb] Deleting volume: 8d69a3ef-fd1f-4d95-87b6-abfada00d66d {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:22:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance spawned successfully.
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:43 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb
Nov 13 23:22:44 user nova-compute[75307]: INFO nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Took 7.70 seconds to spawn the instance on the hypervisor.
Nov 13 23:22:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-94cb77db-25dc-41fd-989f-d140b61cb034 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "d7ae850e-d8ce-4641-8dfb-bebc6fc57bdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.743s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:44 user nova-compute[75307]: INFO nova.compute.manager [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Took 8.54 seconds to build instance.
Nov 13 23:22:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0a8f45d4-8aa9-4cc3-9e00-2c2de272bbe5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.802s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:47 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:22:47 user nova-compute[75307]: INFO nova.compute.claims [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Claim successful on node user
Nov 13 23:22:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:22:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.policy [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b605f62d134435896eb5dce0b48d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4260b68885d4f5ebfa01306bf64a9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:22:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Creating image(s)
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.245s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk 1073741824" returned: 0 in 0.064s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.317s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Successfully created port: cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.240s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Cannot resize image /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Ensure instance console log exists: /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Successfully updated port: cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-changed-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Refreshing instance network info cache due to event network-changed-cc168db1-3a03-4452-bdd0-559e9e53e4d6. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] Acquiring lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.neutron [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating instance_info_cache with network_info: [{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance network_info: |[{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] Acquired lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.neutron [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Refreshing network info cache for port cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start _get_guest_xml network_info=[{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-tempest.common.compute-instance-1606590965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:22:50 user nova-compute[75307]: INFO nova.compute.claims [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Claim successful on node user
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:50 user nova-compute[75307]:   <uuid>9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</uuid>
Nov 13 23:22:50 user nova-compute[75307]:   <name>instance-00000019</name>
Nov 13 23:22:50 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:50 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:50 user nova-compute[75307]:   <metadata>
Nov 13 23:22:50 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:50 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:name>tempest-tempest.common.compute-instance-1606590965</nova:name>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:50</nova:creationTime>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:50 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:50 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:user uuid="7b605f62d134435896eb5dce0b48d51c">tempest-ServerActionsTestOtherA-708902499-project-member</nova:user>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:project uuid="f4260b68885d4f5ebfa01306bf64a9b9">tempest-ServerActionsTestOtherA-708902499</nova:project>
Nov 13 23:22:50 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:50 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:50 user nova-compute[75307]:         <nova:port uuid="cc168db1-3a03-4452-bdd0-559e9e53e4d6">
Nov 13 23:22:50 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:22:50 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:50 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:50 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:50 user nova-compute[75307]:   </metadata>
Nov 13 23:22:50 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:50 user nova-compute[75307]:     <system>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="serial">9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</entry>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="uuid">9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</entry>
Nov 13 23:22:50 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:50 user nova-compute[75307]:     </system>
Nov 13 23:22:50 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:50 user nova-compute[75307]:   <os>
Nov 13 23:22:50 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:50 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:22:50 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:50 user nova-compute[75307]:   </os>
Nov 13 23:22:50 user nova-compute[75307]:   <features>
Nov 13 23:22:50 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:50 user nova-compute[75307]:     <apic/>
Nov 13 23:22:50 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:50 user nova-compute[75307]:   </features>
Nov 13 23:22:50 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:50 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:50 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:50 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:50 user nova-compute[75307]:   </clock>
Nov 13 23:22:50 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:50 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:50 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:50 user nova-compute[75307]:   </cpu>
Nov 13 23:22:50 user nova-compute[75307]:   <devices>
Nov 13 23:22:50 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:50 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:50 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk"/>
Nov 13 23:22:50 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:50 user nova-compute[75307]:     </disk>
Nov 13 23:22:50 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:50 user nova-compute[75307]:       <mac address="fa:16:3e:19:fa:e1"/>
Nov 13 23:22:50 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:50 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:50 user nova-compute[75307]:       <target dev="tapcc168db1-3a"/>
Nov 13 23:22:50 user nova-compute[75307]:     </interface>
Nov 13 23:22:50 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:50 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/console.log" append="off"/>
Nov 13 23:22:50 user nova-compute[75307]:     </serial>
Nov 13 23:22:50 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:50 user nova-compute[75307]:     <video>
Nov 13 23:22:50 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:50 user nova-compute[75307]:     </video>
Nov 13 23:22:50 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:50 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:50 user nova-compute[75307]:     </rng>
Nov 13 23:22:50 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:50 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:50 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:50 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:50 user nova-compute[75307]:   </devices>
Nov 13 23:22:50 user nova-compute[75307]: </domain>
Nov 13 23:22:50 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-tempest.common.compute-instance-1606590965',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG os_vif [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '016b84f2-b927-5f26-b89a-453eb0d242b2', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc168db1-3a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc168db1-3a, col_values=(('qos', UUID('007d31ae-faa4-403c-a96d-866acce71ac3')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc168db1-3a, col_values=(('external_ids', {'iface-id': 'cc168db1-3a03-4452-bdd0-559e9e53e4d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:fa:e1', 'vm-uuid': '9b55c5d0-375b-4f93-a986-ac8cc4bf79d0'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:50 user nova-compute[75307]: INFO os_vif [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a')
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:19:fa:e1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.neutron [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updated VIF entry in instance network info cache for port cc168db1-3a03-4452-bdd0-559e9e53e4d6. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.neutron [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating instance_info_cache with network_info: [{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-636095bd-fb20-4cf8-8f8c-be2c081fc848 req-69cec89c-8dcd-4470-9682-2b50cc4ca9ab service nova] Releasing lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:22:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:22:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.policy [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '30ed4e378e8344ab96e8fa91607b7bf9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dc71aa0370b4722b50f94e861e3be5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:22:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Creating image(s)
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "/opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "/opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk 1073741824" returned: 0 in 0.064s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Successfully created port: bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.207s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Cannot resize image /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Ensure instance console log exists: /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:52 user nova-compute[75307]: WARNING nova.compute.manager [req-c31a7039-017c-4957-8a89-68364277ff6d req-24383461-8cce-4362-b72b-6e1b20df074b service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state building and task_state spawning.
Nov 13 23:22:52 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Successfully updated port: bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquired lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:22:52 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating instance_info_cache with network_info: [{"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Releasing lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Instance network_info: |[{"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Start _get_guest_xml network_info=[{"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:22:53 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:53 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394172118',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394172118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394172118',id=26,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPTkUT40JFzXCc0sfrNbaYvHa68yPQx20BljzA6fQPGc6YYCLocWfviIPBeaq+lcwFJwtQFI5Oe+oqnFQ1JmNqduZLtyPBUS7oMdoXusHjIpVu4KWn6Dl6F+UFmqeZmw==',key_name='tempest-keypair-1406349027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dc71aa0370b4722b50f94e861e3be5b',ramdisk_id='',reservation_id='r-9svlvp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-322297181',owner_user_name='tempest-TestServerVolumeAttachmentScenario-322297181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30ed4e378e8344ab96e8fa91607b7bf9',uuid=5cbefdf9-0ed8-4c05-906e-c77d1bfdc476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converting VIF {"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:22:53 user nova-compute[75307]:   <uuid>5cbefdf9-0ed8-4c05-906e-c77d1bfdc476</uuid>
Nov 13 23:22:53 user nova-compute[75307]:   <name>instance-0000001a</name>
Nov 13 23:22:53 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:22:53 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:22:53 user nova-compute[75307]:   <metadata>
Nov 13 23:22:53 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:22:53 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1394172118</nova:name>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:22:53</nova:creationTime>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:22:53 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:22:53 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:owner>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:user uuid="30ed4e378e8344ab96e8fa91607b7bf9">tempest-TestServerVolumeAttachmentScenario-322297181-project-member</nova:user>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:project uuid="7dc71aa0370b4722b50f94e861e3be5b">tempest-TestServerVolumeAttachmentScenario-322297181</nova:project>
Nov 13 23:22:53 user nova-compute[75307]:       </nova:owner>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:22:53 user nova-compute[75307]:       <nova:ports>
Nov 13 23:22:53 user nova-compute[75307]:         <nova:port uuid="bcaf40a9-c22b-46fb-991b-52f3ed4794fb">
Nov 13 23:22:53 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 23:22:53 user nova-compute[75307]:         </nova:port>
Nov 13 23:22:53 user nova-compute[75307]:       </nova:ports>
Nov 13 23:22:53 user nova-compute[75307]:     </nova:instance>
Nov 13 23:22:53 user nova-compute[75307]:   </metadata>
Nov 13 23:22:53 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:22:53 user nova-compute[75307]:     <system>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="serial">5cbefdf9-0ed8-4c05-906e-c77d1bfdc476</entry>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="uuid">5cbefdf9-0ed8-4c05-906e-c77d1bfdc476</entry>
Nov 13 23:22:53 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:22:53 user nova-compute[75307]:     </system>
Nov 13 23:22:53 user nova-compute[75307]:   </sysinfo>
Nov 13 23:22:53 user nova-compute[75307]:   <os>
Nov 13 23:22:53 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:22:53 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:22:53 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:22:53 user nova-compute[75307]:   </os>
Nov 13 23:22:53 user nova-compute[75307]:   <features>
Nov 13 23:22:53 user nova-compute[75307]:     <acpi/>
Nov 13 23:22:53 user nova-compute[75307]:     <apic/>
Nov 13 23:22:53 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:22:53 user nova-compute[75307]:   </features>
Nov 13 23:22:53 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:22:53 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:22:53 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:22:53 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:22:53 user nova-compute[75307]:   </clock>
Nov 13 23:22:53 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:22:53 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:22:53 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:22:53 user nova-compute[75307]:   </cpu>
Nov 13 23:22:53 user nova-compute[75307]:   <devices>
Nov 13 23:22:53 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:22:53 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:22:53 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk"/>
Nov 13 23:22:53 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:22:53 user nova-compute[75307]:     </disk>
Nov 13 23:22:53 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:22:53 user nova-compute[75307]:       <mac address="fa:16:3e:7c:05:80"/>
Nov 13 23:22:53 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:53 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:22:53 user nova-compute[75307]:       <target dev="tapbcaf40a9-c2"/>
Nov 13 23:22:53 user nova-compute[75307]:     </interface>
Nov 13 23:22:53 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:22:53 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/console.log" append="off"/>
Nov 13 23:22:53 user nova-compute[75307]:     </serial>
Nov 13 23:22:53 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:22:53 user nova-compute[75307]:     <video>
Nov 13 23:22:53 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:22:53 user nova-compute[75307]:     </video>
Nov 13 23:22:53 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:22:53 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:22:53 user nova-compute[75307]:     </rng>
Nov 13 23:22:53 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:22:53 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:22:53 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:22:53 user nova-compute[75307]:     </memballoon>
Nov 13 23:22:53 user nova-compute[75307]:   </devices>
Nov 13 23:22:53 user nova-compute[75307]: </domain>
Nov 13 23:22:53 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394172118',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394172118',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394172118',id=26,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPTkUT40JFzXCc0sfrNbaYvHa68yPQx20BljzA6fQPGc6YYCLocWfviIPBeaq+lcwFJwtQFI5Oe+oqnFQ1JmNqduZLtyPBUS7oMdoXusHjIpVu4KWn6Dl6F+UFmqeZmw==',key_name='tempest-keypair-1406349027',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7dc71aa0370b4722b50f94e861e3be5b',ramdisk_id='',reservation_id='r-9svlvp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-322297181',owner_user_name='tempest-TestServerVolumeAttachmentScenario-322297181-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30ed4e378e8344ab96e8fa91607b7bf9',uuid=5cbefdf9-0ed8-4c05-906e-c77d1bfdc476,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converting VIF {"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG os_vif [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ebc4b173-c01d-5e81-bf9d-2889dad04fa3', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbcaf40a9-c2, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbcaf40a9-c2, col_values=(('qos', UUID('90f56a09-a23b-40eb-9f3b-969bfc8e5799')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbcaf40a9-c2, col_values=(('external_ids', {'iface-id': 'bcaf40a9-c22b-46fb-991b-52f3ed4794fb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:05:80', 'vm-uuid': '5cbefdf9-0ed8-4c05-906e-c77d1bfdc476'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:53 user nova-compute[75307]: INFO os_vif [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2')
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:22:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No VIF found with MAC fa:16:3e:7c:05:80, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:22:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance spawned successfully.
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:54 user nova-compute[75307]: INFO nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Took 5.72 seconds to spawn the instance on the hypervisor.
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:54 user nova-compute[75307]: WARNING nova.compute.manager [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state building and task_state spawning.
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-changed-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Refreshing instance network info cache due to event network-changed-bcaf40a9-c22b-46fb-991b-52f3ed4794fb. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Acquiring lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Acquired lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.network.neutron [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Refreshing network info cache for port bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:22:54 user nova-compute[75307]: INFO nova.compute.manager [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Took 6.59 seconds to build instance.
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3be2a407-6643-4a95-a498-2075fa4cf63e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.706s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.network.neutron [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updated VIF entry in instance network info cache for port bcaf40a9-c22b-46fb-991b-52f3ed4794fb. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG nova.network.neutron [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating instance_info_cache with network_info: [{"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db88e59d-f2ae-48b7-8b56-0a3e23700de1 req-1469233d-ec6a-4194-ad0d-b1e2dfedc846 service nova] Releasing lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] No waiting events found dispatching network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:55 user nova-compute[75307]: WARNING nova.compute.manager [req-b4909c38-faf0-4002-a98d-f20ddc6e075d req-a836c972-22e6-4466-9e59-06d63caecb57 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received unexpected event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb for instance with vm_state building and task_state spawning.
Nov 13 23:22:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:22:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:22:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Instance spawned successfully.
Nov 13 23:22:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] No waiting events found dispatching network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:22:57 user nova-compute[75307]: WARNING nova.compute.manager [req-37886aea-a124-43f1-982a-c8f54a0d61bc req-cb7b2716-e12d-45c8-bb63-74224e355136 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received unexpected event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb for instance with vm_state building and task_state spawning.
Nov 13 23:22:57 user nova-compute[75307]: INFO nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 13 23:22:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:22:57 user nova-compute[75307]: INFO nova.compute.manager [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Took 6.91 seconds to build instance.
Nov 13 23:22:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:22:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e41558b2-2d5b-4cad-960d-a23b3399133d tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.041s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:22:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-changed-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Refreshing instance network info cache due to event network-changed-47e669d9-2897-4d52-8611-36afbf74c293. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Refreshing network info cache for port 47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updated VIF entry in instance network info cache for port 47e669d9-2897-4d52-8611-36afbf74c293. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-faea683f-a77e-492e-ba8c-57ea25a4f209 req-e8cd8a14-f038-4f84-8a78-b8e13c4024f2 service nova] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:23:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:23:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk.rescue --force-share --output=json" returned: 0 in 0.360s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:12 user nova-compute[75307]: INFO nova.compute.manager [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attaching volume bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e to /dev/vdb
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.utils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c357b3-423e-4347-872f-a3854ac03fd6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ec9fd2-9ba2-4087-92bf-c04f008a1298]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e33f063-99e7-4582-92eb-e9d47fd26427]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa3b973-dfc0-4a79-9f2f-d2e0902c8247]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:23:12 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[028712e7-0aa3-4fe5-bc99-0eb93b356b48]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG os_brick.utils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating existing volume attachment record: 3162a598-2b8e-4344-934f-183a71ef0d45 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:23:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7044MB free_disk=25.22716522216797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fdc18eac-a300-4f89-8621-2075decfec01 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:23:14 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:23:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:23:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [{"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-fdc18eac-a300-4f89-8621-2075decfec01" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:23:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfJkaTVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:23:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:23:17 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:23:17 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[07eea27c-e534-4e12-ae3e-74b5b1d7c820]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:23:17 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a4a3bd-3951-47ea-825a-6fc34821776a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e] added
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c7edc6-7b5a-4538-88b3-cf793911cfad]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f37b6e-b499-4bba-b247-7d2efd615e39]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfJkaTVE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nfJkaTVE" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b11937a5-7160-41db-8fdc-19d6994498d5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nfJkaTVE'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae66625b-d0b9-44f4-bf9f-abe191e50216]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0021426-ba54-4635-8eda-8e11a2d7ec44]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bbd82e-a2ca-4d5f-ba8b-8506a43ca2f4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260]
Nov 13 23:23:17 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260] successful.
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c112d959-2fdf-4755-aff1-9b4f6d3e1e3d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f14973-c1a8-4d14-92ac-d43be22df412]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:17 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:17 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:17 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f463ba-2cb1-492a-beb7-2a3d612d1914]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:23:17 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfJkaTVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26166333766323961', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166333766323961', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:23:18 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:23:18 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:23:18 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:23:18 user nova-compute[75307]:   <serial>bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e</serial>
Nov 13 23:23:18 user nova-compute[75307]: </disk>
Nov 13 23:23:18 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:23:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No VIF found with MAC fa:16:3e:80:4b:90, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:23:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d19a39b-c978-4386-b20a-3d6aa0a2de00 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.411s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:22 user nova-compute[75307]: INFO nova.compute.manager [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Detaching volume bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e
Nov 13 23:23:22 user nova-compute[75307]: INFO nova.virt.block_device [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attempting to driver detach volume bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e from mountpoint /dev/vdb
Nov 13 23:23:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Attempting to detach device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:23:22 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:23:22 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:23:22 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:23:22 user nova-compute[75307]:   <serial>bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e</serial>
Nov 13 23:23:22 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:23:22 user nova-compute[75307]: </disk>
Nov 13 23:23:22 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config.
Nov 13 23:23:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:23:22 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:23:22 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:23:22 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:23:22 user nova-compute[75307]:   <serial>bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e</serial>
Nov 13 23:23:22 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:23:22 user nova-compute[75307]: </disk>
Nov 13 23:23:22 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:23:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:23:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:23:36 user nova-compute[75307]: INFO nova.compute.claims [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Claim successful on node user
Nov 13 23:23:36 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:23:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.policy [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:23:37 user nova-compute[75307]: INFO nova.virt.block_device [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Booting with volume 799fe3d4-f050-4fc8-8bee-2b3b0b188c70 at /dev/vda
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.utils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5bb36-5fdf-4568-b492-a76f0aeea937]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a16cf95-d88a-4ac3-8dda-ee0301f873b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3090ea60-17d5-4886-aa13-b5f3b54c1295]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb96cb4-16b8-4d04-a04d-3c721b7dbd04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:23:37 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:23:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be568e8-1606-4b30-9314-a3c0c864f718]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG os_brick.utils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating existing volume attachment record: 17c475b7-ce55-4637-8079-96018ef1913b {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:23:37 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Successfully created port: 0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Successfully updated port: 0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-changed-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Refreshing instance network info cache due to event network-changed-0325d548-3e13-4bf8-ab38-d939622e8d72. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] Acquiring lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating instance_info_cache with network_info: [{"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Instance network_info: |[{"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] Acquired lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:23:38 user nova-compute[75307]: DEBUG nova.network.neutron [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Refreshing network info cache for port 0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:23:39 user nova-compute[75307]: DEBUG nova.network.neutron [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updated VIF entry in instance network info cache for port 0325d548-3e13-4bf8-ab38-d939622e8d72. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:23:39 user nova-compute[75307]: DEBUG nova.network.neutron [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating instance_info_cache with network_info: [{"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:23:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7b193c9b-b133-4026-ac31-5313f382f80d req-eec682d9-acbf-4c89-8c2a-aa42835db9f8 service nova] Releasing lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:23:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Creating image(s)
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Ensure instance console log exists: /opt/stack/data/nova/instances/ee73e99a-6a19-4ea0-add9-54356a61f5b0/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Start _get_guest_xml network_info=[{"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee73e99a-6a19-4ea0-add9-54356a61f5b0', 'attached_at': '', 'detached_at': '', 'volume_id': '799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'serial': '799fe3d4-f050-4fc8-8bee-2b3b0b188c70'}, 'delete_on_termination': False, 'attachment_id': '17c475b7-ce55-4637-8079-96018ef1913b', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:23:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:23:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:23:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:23:41 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:23:41 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe4446-f353-44cc-847b-deb7c544f874]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:23:41 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a998fe56-dcf1-4c3b-ad2d-5fe25adb7d8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70] added
Nov 13 23:23:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0337c6-714d-45c8-a907-d460f6996eb6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a81256e-92b9-4f12-8038-227c558ec60f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtiVsSL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtiVsSL" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb44894-22f2-4e42-b46c-8e51ce31f49d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xHtiVsSL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e562a89f-ae2a-4f16-abf4-be855f1b474b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bfba04-d304-4cad-a3d8-85db99b32de7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:42 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:42 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee32f39e-88d7-408e-94c9-d57029abf97e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]
Nov 13 23:23:42 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.
Nov 13 23:23:42 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e3f76d-be37-4a8b-b190-d6c843bac042]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5f6471-b2f4-45e8-95d4-7dbfc48373ff]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:42 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:23:42 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ef801d-ca0a-4214-99b3-5a3bbf3af0ee]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 is timed out.
Nov 13 23:23:42 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config.
Nov 13 23:23:42 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nfJkaTVE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:23:42 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:23:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26435303433633237', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303433633237', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.412s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9074dc-3452-444c-a70f-1decb06a37bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:23:43 user nova-compute[75307]: No targets found.
Nov 13 23:23:43 user nova-compute[75307]: iSNS:
Nov 13 23:23:43 user nova-compute[75307]: No targets found.
Nov 13 23:23:43 user nova-compute[75307]: STATIC:
Nov 13 23:23:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:23:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:23:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:23:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:23:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:23:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:23:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e
Nov 13 23:23:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:23:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:23:43 user nova-compute[75307]: FIRMWARE:
Nov 13 23:23:43 user nova-compute[75307]: No targets found.
Nov 13 23:23:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:23:43 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:23:43 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2066119474',display_name='tempest-TestVolumeBootPattern-server-2066119474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2066119474',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-29m4rvs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:23:37Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=ee73e99a-6a19-4ea0-add9-54356a61f5b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.objects.instance [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid ee73e99a-6a19-4ea0-add9-54356a61f5b0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b12904-e1f3-4829-a131-ebcce110d464]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:23:43 user nova-compute[75307]:   <uuid>ee73e99a-6a19-4ea0-add9-54356a61f5b0</uuid>
Nov 13 23:23:43 user nova-compute[75307]:   <name>instance-0000001b</name>
Nov 13 23:23:43 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:23:43 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:23:43 user nova-compute[75307]:   <metadata>
Nov 13 23:23:43 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:23:43 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:23:43 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-server-2066119474</nova:name>
Nov 13 23:23:43 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:23:41</nova:creationTime>
Nov 13 23:23:43 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:23:43 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:23:43 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:23:43 user nova-compute[75307]:       <nova:owner>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:23:43 user nova-compute[75307]:       </nova:owner>
Nov 13 23:23:43 user nova-compute[75307]:       <nova:ports>
Nov 13 23:23:43 user nova-compute[75307]:         <nova:port uuid="0325d548-3e13-4bf8-ab38-d939622e8d72">
Nov 13 23:23:43 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:23:43 user nova-compute[75307]:         </nova:port>
Nov 13 23:23:43 user nova-compute[75307]:       </nova:ports>
Nov 13 23:23:43 user nova-compute[75307]:     </nova:instance>
Nov 13 23:23:43 user nova-compute[75307]:   </metadata>
Nov 13 23:23:43 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:23:43 user nova-compute[75307]:     <system>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="serial">ee73e99a-6a19-4ea0-add9-54356a61f5b0</entry>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="uuid">ee73e99a-6a19-4ea0-add9-54356a61f5b0</entry>
Nov 13 23:23:43 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:23:43 user nova-compute[75307]:     </system>
Nov 13 23:23:43 user nova-compute[75307]:   </sysinfo>
Nov 13 23:23:43 user nova-compute[75307]:   <os>
Nov 13 23:23:43 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:23:43 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:23:43 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:23:43 user nova-compute[75307]:   </os>
Nov 13 23:23:43 user nova-compute[75307]:   <features>
Nov 13 23:23:43 user nova-compute[75307]:     <acpi/>
Nov 13 23:23:43 user nova-compute[75307]:     <apic/>
Nov 13 23:23:43 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:23:43 user nova-compute[75307]:   </features>
Nov 13 23:23:43 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:23:43 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:23:43 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:23:43 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:23:43 user nova-compute[75307]:   </clock>
Nov 13 23:23:43 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:23:43 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:23:43 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:23:43 user nova-compute[75307]:   </cpu>
Nov 13 23:23:43 user nova-compute[75307]:   <devices>
Nov 13 23:23:43 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:23:43 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:23:43 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:23:43 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:23:43 user nova-compute[75307]:       <serial>799fe3d4-f050-4fc8-8bee-2b3b0b188c70</serial>
Nov 13 23:23:43 user nova-compute[75307]:     </disk>
Nov 13 23:23:43 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:23:43 user nova-compute[75307]:       <mac address="fa:16:3e:c4:b7:f0"/>
Nov 13 23:23:43 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:23:43 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:23:43 user nova-compute[75307]:       <target dev="tap0325d548-3e"/>
Nov 13 23:23:43 user nova-compute[75307]:     </interface>
Nov 13 23:23:43 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:23:43 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/ee73e99a-6a19-4ea0-add9-54356a61f5b0/console.log" append="off"/>
Nov 13 23:23:43 user nova-compute[75307]:     </serial>
Nov 13 23:23:43 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:23:43 user nova-compute[75307]:     <video>
Nov 13 23:23:43 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:23:43 user nova-compute[75307]:     </video>
Nov 13 23:23:43 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:23:43 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:23:43 user nova-compute[75307]:     </rng>
Nov 13 23:23:43 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:23:43 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:23:43 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:23:43 user nova-compute[75307]:     </memballoon>
Nov 13 23:23:43 user nova-compute[75307]:   </devices>
Nov 13 23:23:43 user nova-compute[75307]: </domain>
Nov 13 23:23:43 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2066119474',display_name='tempest-TestVolumeBootPattern-server-2066119474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2066119474',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-29m4rvs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:23:37Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=ee73e99a-6a19-4ea0-add9-54356a61f5b0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_vif [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '777c4ebc-0424-5033-a3c3-49b4ee6e02fe', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0325d548-3e, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0325d548-3e, col_values=(('qos', UUID('63aacd66-f718-49b3-90d9-06dde04bdfe0')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0325d548-3e, col_values=(('external_ids', {'iface-id': '0325d548-3e13-4bf8-ab38-d939622e8d72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:b7:f0', 'vm-uuid': 'ee73e99a-6a19-4ea0-add9-54356a61f5b0'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6de1c3-5b51-469f-9411-c1cb2e9807d6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:43 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:43 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:23:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:23:43 user nova-compute[75307]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e (non-flash)
Nov 13 23:23:43 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:23:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb343392d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:43 user nova-compute[75307]: INFO os_vif [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e')
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc1ca5e-f66b-4959-9e23-7d6691cbc336]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[538b9cbe-b63a-4e6d-801b-e34518f3f063]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:c4:b7:f0, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b62848-7b0f-42ce-8ba1-fbbb20db7b8c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2baf0bd-01e9-4558-818e-6f0841be3369]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0265787c-60e4-46f6-8789-9ff061d70298]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5269945f-b7c5-44fe-be1f-8f956ba2474a]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260]
Nov 13 23:23:43 user nova-compute[75307]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e, portal: 172.16.0.220,3260] successful.
Nov 13 23:23:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf39c62d-a7fe-4a12-8978-c28fb0f0ea1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5310722e-29c9-4ecc-b997-348abc0d3755]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== disconnect_volume: return (717ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:23:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:23:44 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:23:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a4856aa2-52fe-46ad-8ac7-f8011141ef87 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.112s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] No waiting events found dispatching network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:23:45 user nova-compute[75307]: WARNING nova.compute.manager [req-cfed4df7-36d7-4026-a09a-a10c588490d6 req-02694507-e532-4f7d-aa75-9cb677fab16a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received unexpected event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 for instance with vm_state building and task_state spawning.
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:23:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Instance spawned successfully.
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:23:46 user nova-compute[75307]: INFO nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 13 23:23:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:23:46 user nova-compute[75307]: INFO nova.compute.manager [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Took 10.43 seconds to build instance.
Nov 13 23:23:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5ae7e3ff-066b-41eb-86e4-3f69c5acad1e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.523s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] No waiting events found dispatching network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:23:47 user nova-compute[75307]: WARNING nova.compute.manager [req-2ca2f85b-b2c9-4524-8e97-2991c0d63254 req-91a372f7-5020-4e2a-96b5-8770202e635a service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received unexpected event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 for instance with vm_state active and task_state None.
Nov 13 23:23:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:57 user nova-compute[75307]: INFO nova.compute.manager [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Unrescuing
Nov 13 23:23:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:23:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:23:57 user nova-compute[75307]: DEBUG nova.network.neutron [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'flavor' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:23:58 user nova-compute[75307]: WARNING nova.compute.manager [req-323fa0a2-e0fb-431e-bfcc-6bff986e80ad req-e83d079a-2d76-4139-b6be-83eb4f597887 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:58 user nova-compute[75307]: INFO nova.compute.manager [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Terminating instance
Nov 13 23:23:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance destroyed successfully.
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-95dccd27-fa54-41bf-b489-773b74322965 req-a861d896-3356-40f5-afda-78c21a05bf99 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-unplugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:23:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Instance destroyed successfully.
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'resources' on Instance uuid fdc18eac-a300-4f89-8621-2075decfec01 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-15052950',display_name='tempest-AttachVolumeTestJSON-server-15052950',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-15052950',id=4,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHbkdTUEjsqmAkTLz2E22/7oGGNCwM1iH89DgVDlez7f4VNufNdy/MmfK/0AXZS/DE8szHhpQZBEAEa1LzzfZnHiUY/vyD/7gM1/9/e03RW6SZFICf1U25ZDESv51dxMxA==',key_name='tempest-keypair-1912979494',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:14:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-2mft7jyy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:22:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=fdc18eac-a300-4f89-8621-2075decfec01,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "address": "fa:16:3e:7a:10:97", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6511cea-1a", "ovs_interfaceid": "d6511cea-1a73-4612-bd4b-5a50bd96a3b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG os_vif [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6511cea-1a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bac6fa04-17b1-40f3-8375-71cdd33514f1) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: INFO os_vif [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:10:97,bridge_name='br-int',has_traffic_filtering=True,id=d6511cea-1a73-4612-bd4b-5a50bd96a3b1,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6511cea-1a')
Nov 13 23:24:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Deleting instance files /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01_del
Nov 13 23:24:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Deletion of /opt/stack/data/nova/instances/fdc18eac-a300-4f89-8621-2075decfec01_del complete
Nov 13 23:24:00 user nova-compute[75307]: INFO nova.compute.manager [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Took 1.33 seconds to destroy the instance on the hypervisor.
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:00 user nova-compute[75307]: WARNING nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing instance network info cache due to event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:00 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:00 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Took 0.71 seconds to deallocate network for instance.
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] Acquiring lock "fdc18eac-a300-4f89-8621-2075decfec01-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] Lock "fdc18eac-a300-4f89-8621-2075decfec01-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] No waiting events found dispatching network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:01 user nova-compute[75307]: WARNING nova.compute.manager [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received unexpected event network-vif-plugged-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 for instance with vm_state deleted and task_state None.
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-e767bd53-6485-4ad4-9eea-4769075d5d3f req-58fc0074-bdb3-4724-b24c-da71cc5f28a0 service nova] [instance: fdc18eac-a300-4f89-8621-2075decfec01] Received event network-vif-deleted-d6511cea-1a73-4612-bd4b-5a50bd96a3b1 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updated VIF entry in instance network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing instance network info cache due to event network-changed-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Refreshing network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:01 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Deleted allocations for instance fdc18eac-a300-4f89-8621-2075decfec01
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c7847c6-99c9-4247-b18e-934e1375bb7b tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "fdc18eac-a300-4f89-8621-2075decfec01" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.777s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updated VIF entry in instance network info cache for port a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG nova.network.neutron [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3993ef84-2b46-4db3-85a1-6d541886cfa6 req-116faa69-4e6a-4800-85b5-9a3319208440 service nova] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:02 user nova-compute[75307]: WARNING nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:24:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:02 user nova-compute[75307]: WARNING nova.compute.manager [req-3d70d97a-c30c-4609-9314-19fc370618f6 req-d9804c4f-b8fb-4f07-9183-8cef29370a68 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:24:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-142702ea-be73-4a82-bad2-55a787c7bf04 tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:24:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:24:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:24:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.221214294433594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ee73e99a-6a19-4ea0-add9-54356a61f5b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:14 user nova-compute[75307]: INFO nova.compute.manager [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attaching volume da27535f-63ac-42fc-b8f2-be8a694bb395 to /dev/vdb
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.utils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[168ac0f4-ed72-442a-aff2-dfa923767f19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d950b96-1e37-450f-b0ae-75c4b111be9f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a5f742-0192-4ac8-a7cf-0270f897c994]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3607af15-c232-4c45-9bd3-54777e91dc49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:15 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6b7b8-4dd5-4792-9be6-075520da1413]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG os_brick.utils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating existing volume attachment record: 89e04589-f753-4b7f-a55c-3bcfce33c005 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [{"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-c6b7203a-cce3-452a-9002-10011310b3e2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:24:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjasNmzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:19 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:19 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:19 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b8b5b6-11ba-4b76-bfe0-6becf4440e38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:19 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fac44a3-ef0e-4f5c-854d-9e1a70dcb9d4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395] added
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b3710b-2db0-4386-9b18-903b778cd763]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[635b4935-dd68-4a46-a840-786be2a52422]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjasNmzC {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cjasNmzC" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb5c009-a33f-40b3-a31c-6c8391a9af31]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cjasNmzC'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[766be297-2082-4a00-96fd-4643688939d9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a55384-1763-455a-a3a0-bb3da52fe9da]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[78afafc8-ca8b-4437-a71f-ea06017fbd02]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260]
Nov 13 23:24:19 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fea045c-2c50-42e6-a9cf-b7778658de17]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[13366d69-911e-4c8c-bb45-abf1a65c97ae]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[93adc9b5-2541-4dc9-9814-d21b5cd7cfe2]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjasNmzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23438393163613465', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438393163613465', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:20 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:20 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:24:20 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:20 user nova-compute[75307]:   <serial>da27535f-63ac-42fc-b8f2-be8a694bb395</serial>
Nov 13 23:24:20 user nova-compute[75307]: </disk>
Nov 13 23:24:20 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No VIF found with MAC fa:16:3e:80:4b:90, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d107ae2-2222-46c0-9d19-53886a536540 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing instance network info cache due to event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] Acquiring lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] Acquired lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updated VIF entry in instance network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating instance_info_cache with network_info: [{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.objects.instance [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d286cd-809e-40b0-9b56-61d7261f16b0 req-77334025-7026-4f40-a808-e7290e6bb1c2 service nova] Releasing lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:23 user nova-compute[75307]: INFO nova.compute.manager [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Detaching volume da27535f-63ac-42fc-b8f2-be8a694bb395
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:23 user nova-compute[75307]: INFO nova.compute.manager [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Attaching volume 4dc09455-9977-4d89-bdea-923ea31dd8bf to /dev/vdb
Nov 13 23:24:23 user nova-compute[75307]: INFO nova.virt.block_device [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attempting to driver detach volume da27535f-63ac-42fc-b8f2-be8a694bb395 from mountpoint /dev/vdb
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Attempting to detach device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:23 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:23 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:24:23 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:23 user nova-compute[75307]:   <serial>da27535f-63ac-42fc-b8f2-be8a694bb395</serial>
Nov 13 23:24:23 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:23 user nova-compute[75307]: </disk>
Nov 13 23:24:23 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:23 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config.
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:23 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:23 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:24:23 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:23 user nova-compute[75307]:   <serial>da27535f-63ac-42fc-b8f2-be8a694bb395</serial>
Nov 13 23:24:23 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:23 user nova-compute[75307]: </disk>
Nov 13 23:24:23 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.utils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97a4da4-46d2-4d85-a6ca-2098f182f8f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc841ef9-16a7-4ba0-b63a-70d673f77f84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9021bb-6862-40a1-a59c-fefd50eefd92]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca803e62-0fc5-416d-bf3b-28d20bd5f6b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:23 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0410d019-8778-484a-bf36-b107ab115ebf]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG os_brick.utils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating existing volume attachment record: 28671536-d180-4e73-a271-f9b38bfa73b9 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:24:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing instance network info cache due to event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.objects.instance [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'flavor' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updated VIF entry in instance network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:26 user nova-compute[75307]: INFO nova.compute.manager [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Attaching volume 7c646ffa-1e24-4c18-bfd5-7065a4f5a42f to /dev/vdb
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-888e0c99-842e-46ba-9841-9799a12b77c1 req-59c11dd5-1308-44c3-b2db-4b9e1bee2438 service nova] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.utils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d955fac-0beb-476c-9ed0-3b54575441d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fee86b3-aeb8-4dc3-be14-c085440eea4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e15288-7018-4559-87b0-8a7ca2a8c00e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[025ca6fa-95f1-4384-932b-61627dcca19d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:26 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42394744-409c-465e-bfed-dc6917e73f40]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG os_brick.utils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:26 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating existing volume attachment record: cc2c878b-9892-4cea-b8aa-4b4fc618af13 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhyBeKdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:27 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d0b506-6cd0-4ac6-a3d2-bbc503cf924e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:27 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b0e9c-dec6-4f28-b3ca-f9925eb3ac55]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf] added
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568c21f-5a9b-4f41-b7c3-0cc276cf21f7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a46e1d-66d3-4763-a4aa-08b5d479e443]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhyBeKdQ {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhyBeKdQ" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc2bb41-d40e-40ac-85ca-276bfd2481e8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhyBeKdQ'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[965d44c3-e7a4-44b2-b226-72196ec76999]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad1cef3-7ca5-47c4-bc03-31cad9469cd4]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d3fe19a-f354-4746-9c98-0a6fb81d99ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260]
Nov 13 23:24:27 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[559e8138-658f-46d5-8d95-43a62da639d8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be171145-0ae2-473b-9728-cbf3de5493c6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:27 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea45036-da67-4da2-8727-fdf66439610b]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhyBeKdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23461386233643237', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461386233643237', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:29 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:29 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:24:29 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:29 user nova-compute[75307]:   <serial>4dc09455-9977-4d89-bdea-923ea31dd8bf</serial>
Nov 13 23:24:29 user nova-compute[75307]: </disk>
Nov 13 23:24:29 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No VIF found with MAC fa:16:3e:a6:57:36, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-57777ee3-f094-4cec-94c5-fe9130efa838 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.242s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trZNKEBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:30 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569bf28-d40c-4487-b8b2-c994afe94d64]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:30 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f93d8-e0f9-459d-b172-4cc5ae8f676a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f] added
Nov 13 23:24:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8903ffea-e93f-4106-83fe-6853ebf1c381]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40ce3cd-3526-48cb-bdb3-9c232616dec2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trZNKEBF {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v trZNKEBF" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ee3dd3-c22c-490f-b71b-11c6a5e7ba84]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'trZNKEBF'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d9ee4-0104-4a75-b786-a4f96c9bef4a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66474987-d59e-476b-9fdc-50bd99ce5ad6]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:30 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd1b5ee-c1f7-42b4-8912-c7701eb2b1da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260]
Nov 13 23:24:30 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6ef51e-c3ee-4dfe-858f-d43c67b1bd70]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4747311b-a561-42ed-8648-9aead3418bf7]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:31 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:31 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd476f0d-046b-49b5-b863-59c5116e5437]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.compute.manager [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Detaching volume 70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.virt.block_device [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Attempting to driver detach volume 70d9cf58-3652-4ef6-9707-8523ea18eb04 from mountpoint /dev/vdb
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Attempting to detach device vdb from instance c6b7203a-cce3-452a-9002-10011310b3e2 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:31 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:24:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:31 user nova-compute[75307]:   <serial>70d9cf58-3652-4ef6-9707-8523ea18eb04</serial>
Nov 13 23:24:31 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:31 user nova-compute[75307]: </disk>
Nov 13 23:24:31 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Successfully detached device vdb from instance c6b7203a-cce3-452a-9002-10011310b3e2 from the persistent domain config.
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c6b7203a-cce3-452a-9002-10011310b3e2 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:31 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:24:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:31 user nova-compute[75307]:   <serial>70d9cf58-3652-4ef6-9707-8523ea18eb04</serial>
Nov 13 23:24:31 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:31 user nova-compute[75307]: </disk>
Nov 13 23:24:31 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.compute.manager [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Detaching volume 4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.virt.block_device [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Attempting to driver detach volume 4dc09455-9977-4d89-bdea-923ea31dd8bf from mountpoint /dev/vdb
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Attempting to detach device vdb from instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:31 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:24:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:31 user nova-compute[75307]:   <serial>4dc09455-9977-4d89-bdea-923ea31dd8bf</serial>
Nov 13 23:24:31 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:31 user nova-compute[75307]: </disk>
Nov 13 23:24:31 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully detached device vdb from instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 from the persistent domain config.
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:31 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:24:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:31 user nova-compute[75307]:   <serial>4dc09455-9977-4d89-bdea-923ea31dd8bf</serial>
Nov 13 23:24:31 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:31 user nova-compute[75307]: </disk>
Nov 13 23:24:31 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trZNKEBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '26539636665656539', 'path': '/dev/sdf'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539636665656539', 'path': '/dev/sdf'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'flavor' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:32 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:32 user nova-compute[75307]:   <source dev="/dev/sdf"/>
Nov 13 23:24:32 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:32 user nova-compute[75307]:   <serial>7c646ffa-1e24-4c18-bfd5-7065a4f5a42f</serial>
Nov 13 23:24:32 user nova-compute[75307]: </disk>
Nov 13 23:24:32 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:f8:75:21, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-80cfecb9-e8c4-4bba-9503-24cdd8d69e2b tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.075s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:33 user nova-compute[75307]: INFO nova.compute.manager [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Rescuing
Nov 13 23:24:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:34 user nova-compute[75307]: WARNING nova.compute.manager [req-300c88b4-44da-4dfb-b182-f935be63011a req-969d09bd-c62c-48f5-86b4-3bb7d368e9ad service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state active and task_state rescuing.
Nov 13 23:24:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance destroyed successfully.
Nov 13 23:24:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Attempting rescue
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:24:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Creating image(s)
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'trusted_certs' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue" returned: 0 in 0.046s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'migration_context' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<f6a7736a-5973-40cd-8e8e-0404353941c1> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start _get_guest_xml network_info=[{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f8:75:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<f6a7736a-5973-40cd-8e8e-0404353941c1> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'numa_topology' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<f6a7736a-5973-40cd-8e8e-0404353941c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:24:34 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:34 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'vcpu_model' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<f6a7736a-5973-40cd-8e8e-0404353941c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-551549900',display_name='tempest-ServerRescueNegativeTestJSON-server-551549900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-551549900',id=24,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAtqBJtxyMkvcPp7JlAXa+kLS85YNSUkgLrctZnBQ6Ae9TSu8Y6PKws/M+1yXgAOiQdEvLI7C+Q9wLe76rK2SBB/ciJtsrcKfxWhf3vhVPgV+FCvuOtSNQKPU7FgwsQIA==',key_name='tempest-keypair-602851905',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-la018wet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:22:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=f6a7736a-5973-40cd-8e8e-0404353941c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f8:75:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "vif_mac": "fa:16:3e:f8:75:21"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'pci_devices' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Object Instance<f6a7736a-5973-40cd-8e8e-0404353941c1> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:24:34 user nova-compute[75307]:   <uuid>f6a7736a-5973-40cd-8e8e-0404353941c1</uuid>
Nov 13 23:24:34 user nova-compute[75307]:   <name>instance-00000018</name>
Nov 13 23:24:34 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:24:34 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:24:34 user nova-compute[75307]:   <metadata>
Nov 13 23:24:34 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:24:34 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-551549900</nova:name>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:24:34</nova:creationTime>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:24:34 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:24:34 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:owner>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:user uuid="8ca0ce44f4d041b5b98883e3796abe32">tempest-ServerRescueNegativeTestJSON-1822128029-project-member</nova:user>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:project uuid="7260b3ec00fc412091e6db3c55993345">tempest-ServerRescueNegativeTestJSON-1822128029</nova:project>
Nov 13 23:24:34 user nova-compute[75307]:       </nova:owner>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:24:34 user nova-compute[75307]:       <nova:ports>
Nov 13 23:24:34 user nova-compute[75307]:         <nova:port uuid="4ceb2d7f-b19c-4adc-b4e4-98aed704f613">
Nov 13 23:24:34 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 13 23:24:34 user nova-compute[75307]:         </nova:port>
Nov 13 23:24:34 user nova-compute[75307]:       </nova:ports>
Nov 13 23:24:34 user nova-compute[75307]:     </nova:instance>
Nov 13 23:24:34 user nova-compute[75307]:   </metadata>
Nov 13 23:24:34 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:24:34 user nova-compute[75307]:     <system>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="serial">f6a7736a-5973-40cd-8e8e-0404353941c1</entry>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="uuid">f6a7736a-5973-40cd-8e8e-0404353941c1</entry>
Nov 13 23:24:34 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:24:34 user nova-compute[75307]:     </system>
Nov 13 23:24:34 user nova-compute[75307]:   </sysinfo>
Nov 13 23:24:34 user nova-compute[75307]:   <os>
Nov 13 23:24:34 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:24:34 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:24:34 user nova-compute[75307]:   </os>
Nov 13 23:24:34 user nova-compute[75307]:   <features>
Nov 13 23:24:34 user nova-compute[75307]:     <acpi/>
Nov 13 23:24:34 user nova-compute[75307]:     <apic/>
Nov 13 23:24:34 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:24:34 user nova-compute[75307]:   </features>
Nov 13 23:24:34 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:24:34 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:24:34 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:24:34 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:24:34 user nova-compute[75307]:   </clock>
Nov 13 23:24:34 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:24:34 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:24:34 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:24:34 user nova-compute[75307]:   </cpu>
Nov 13 23:24:34 user nova-compute[75307]:   <devices>
Nov 13 23:24:34 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:24:34 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:24:34 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue"/>
Nov 13 23:24:34 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:24:34 user nova-compute[75307]:     </disk>
Nov 13 23:24:34 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:24:34 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:24:34 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk"/>
Nov 13 23:24:34 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:24:34 user nova-compute[75307]:     </disk>
Nov 13 23:24:34 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:24:34 user nova-compute[75307]:       <mac address="fa:16:3e:f8:75:21"/>
Nov 13 23:24:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:34 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:24:34 user nova-compute[75307]:       <target dev="tap4ceb2d7f-b1"/>
Nov 13 23:24:34 user nova-compute[75307]:     </interface>
Nov 13 23:24:34 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:24:34 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/console.log" append="off"/>
Nov 13 23:24:34 user nova-compute[75307]:     </serial>
Nov 13 23:24:34 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:24:34 user nova-compute[75307]:     <video>
Nov 13 23:24:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:34 user nova-compute[75307]:     </video>
Nov 13 23:24:34 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:24:34 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:24:34 user nova-compute[75307]:     </rng>
Nov 13 23:24:34 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:24:34 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:24:34 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:24:34 user nova-compute[75307]:     </memballoon>
Nov 13 23:24:34 user nova-compute[75307]:   </devices>
Nov 13 23:24:34 user nova-compute[75307]: </domain>
Nov 13 23:24:34 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:24:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance destroyed successfully.
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] No VIF found with MAC fa:16:3e:f8:75:21, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:36 user nova-compute[75307]: WARNING nova.compute.manager [req-f077af80-8552-41a4-9085-c9d777dc786f req-b0be55df-3cb1-4dbc-b0c8-b8d894e8280f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state active and task_state rescuing.
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:38 user nova-compute[75307]: WARNING nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state active and task_state rescuing.
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:38 user nova-compute[75307]: WARNING nova.compute.manager [req-1c969aed-36e7-4bf8-a177-3bf7b3795182 req-6b382546-f9d9-4782-b666-bfac0b229b77 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state active and task_state rescuing.
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f0ff4562-44b2-4a33-940f-d2da062dd35a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-changed-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Refreshing instance network info cache due to event network-changed-cc168db1-3a03-4452-bdd0-559e9e53e4d6. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] Acquiring lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] Acquired lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.network.neutron [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Refreshing network info cache for port cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.network.neutron [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updated VIF entry in instance network info cache for port cc168db1-3a03-4452-bdd0-559e9e53e4d6. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:38 user nova-compute[75307]: DEBUG nova.network.neutron [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating instance_info_cache with network_info: [{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-54fd8b4f-dc74-4940-8506-ab15dc39b6bb req-3a2dc981-c702-46d5-bf70-2d8ce49e56aa service nova] Releasing lock "refresh_cache-9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'flavor' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:39 user nova-compute[75307]: INFO nova.compute.manager [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attaching volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168 to /dev/vdb
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.utils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[128c6e32-5ab7-4772-9d8f-c519b40e1e34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[26df05da-633b-41fd-8480-faea165d6474]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7834379c-7eeb-4d5d-883e-a990bbcdd4f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c3e54a-43c8-4239-b0da-f61b752475ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:39 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:39 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[98768b9a-12e7-4272-a986-a51f80e1d9c1]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG os_brick.utils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:39 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating existing volume attachment record: 7fe4e251-9e62-4fc9-a1b3-73cd74bef54b {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-changed-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Refreshing instance network info cache due to event network-changed-bcaf40a9-c22b-46fb-991b-52f3ed4794fb. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] Acquiring lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] Acquired lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:40 user nova-compute[75307]: DEBUG nova.network.neutron [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Refreshing network info cache for port bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG nova.network.neutron [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updated VIF entry in instance network info cache for port bcaf40a9-c22b-46fb-991b-52f3ed4794fb. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG nova.network.neutron [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating instance_info_cache with network_info: [{"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-03a76550-1b77-474f-8c5e-80799245d69c req-eb028f91-e43b-428c-b9bf-e722a3a614ff service nova] Releasing lock "refresh_cache-5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG nova.objects.instance [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:42 user nova-compute[75307]: INFO nova.compute.manager [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attaching volume a071e26f-a3a6-486c-b643-7f1982c108ff to /dev/vdb
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.utils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cec507b-6337-4849-bae3-8720f3865846]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[14be6ab9-d784-4111-97ea-12e64aeff108]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1691c8a-e7ba-45c0-95da-4f6c1820c8bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c227c-6d7d-45fd-9691-c5101ca28aca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:42 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:42 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b9a51b-1cff-46f4-b770-0e56a00bfe8a]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG os_brick.utils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating existing volume attachment record: 233f68ad-19e5-4a8e-a2e9-9b17d81d7ba0 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 is timed out.
Nov 13 23:24:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config.
Nov 13 23:24:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cjasNmzC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:43 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ca37a0-5900-47fb-b05c-fd07e3c1d740]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:24:43 user nova-compute[75307]: No targets found.
Nov 13 23:24:43 user nova-compute[75307]: iSNS:
Nov 13 23:24:43 user nova-compute[75307]: No targets found.
Nov 13 23:24:43 user nova-compute[75307]: STATIC:
Nov 13 23:24:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:24:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395
Nov 13 23:24:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:24:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:43 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:24:43 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:43 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:43 user nova-compute[75307]: FIRMWARE:
Nov 13 23:24:43 user nova-compute[75307]: No targets found.
Nov 13 23:24:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:24:43 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:24:43 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a60db25-f492-431c-bb8a-2ca80b881dd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a89fb0-c209-4a6a-b747-2d156f497da2]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:43 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:43 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34296710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f974f9-b6d3-4871-969f-97d4e4759ab5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a94edae-3270-48aa-a35c-7212927149d8]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783d14e-d2f3-48a3-84dd-ceded97c09da]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2feb61c2-f7f4-4f89-a845-6c32df019efe]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:24:43 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a231e129-459b-4305-b690-afa573d74bfb]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9bbf49-9242-4238-9d6e-ffe134d5578d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260]
Nov 13 23:24:44 user nova-compute[75307]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:44 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da27535f-63ac-42fc-b8f2-be8a694bb395 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f27bf3-5a57-4df7-8050-ee27c529e8df]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== disconnect_volume: return (329ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.034s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:44 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:44 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f28b3ee-72c4-46a2-a375-b4d6677163d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:44 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de45b897-ee3f-4118-ba74-c3cf9daf956f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168] added
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61ac481-4072-40e6-b3ee-269e184c4dbf]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a00b86-0c60-4f06-b346-4f85fe022849]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovstHaVA {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovstHaVA" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e19259-baf3-42df-bcf4-32399a608753]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovstHaVA'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca1b398-9aa8-4203-a3a3-d207ec8f05be]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9fb03ea-ed5c-4f82-96ec-52c2c4052814]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e97edaf-5481-44d7-b2d6-15c37773631b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]
Nov 13 23:24:44 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d9a2ea-0355-48fd-b58e-5ee90516fdb6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d235b661-fcda-4beb-bc00-a3f18e542066]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:44 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f96c127-e446-469d-bfbd-27f2a64e0f0a]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d6aaac86-93e2-4d28-87ec-65da3db0610b tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.693s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26235616233343864', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235616233343864', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'flavor' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:45 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:45 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:24:45 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:45 user nova-compute[75307]:   <serial>5bb0dbe6-7f66-4e20-9218-509ff7cb5168</serial>
Nov 13 23:24:45 user nova-compute[75307]: </disk>
Nov 13 23:24:45 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:19:fa:e1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fd40f3ae-66d3-46a2-8ec4-e8d9bb04eca6 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.715s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKOigaoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:46 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:46 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:46 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31aa8f8-2304-4fea-8dbf-57525b1e108f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:46 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce9918a-0182-4d28-8030-b60170f2275c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff] added
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff13384-9e0f-47ff-aee6-319f7d397155]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[074ee6c6-acc6-41c9-8c90-eae90cbf1dc7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKOigaoU {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xKOigaoU" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b98d5-3b63-4088-86a4-a9197d29c717]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xKOigaoU'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cea54b-0177-43de-9f52-ba698d4a9c45]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[98efabed-700a-4d5b-81aa-a07e42394e94]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9eceedd-e58a-43b5-9600-7d3af26d73b0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260]
Nov 13 23:24:46 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6855552a-f840-4b6f-9308-8686e5150382]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b89d4-db7a-4942-bab1-b8f42b4d5b2a]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:46 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:46 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] HCTL ('38', '-', '-', 0) found on session 33 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c882f10f-3c5a-4801-a78c-4de95294a274]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:46 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Searching for a device in session 33 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKOigaoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26630376561653131', 'path': '/dev/sdg'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630376561653131', 'path': '/dev/sdg'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:47 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:47 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:24:47 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:47 user nova-compute[75307]:   <serial>a071e26f-a3a6-486c-b643-7f1982c108ff</serial>
Nov 13 23:24:47 user nova-compute[75307]: </disk>
Nov 13 23:24:47 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:47 user nova-compute[75307]: INFO nova.compute.manager [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Rebuilding instance
Nov 13 23:24:47 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No VIF found with MAC fa:16:3e:7c:05:80, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:48 user nova-compute[75307]: WARNING nova.compute.manager [req-91403a71-01d0-445b-9615-e7ecdc6660ba req-9f08cb58-eab6-4006-8725-2d1e81ace78e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state active and task_state rebuilding.
Nov 13 23:24:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-73ee586f-bbbd-4fe6-909d-944b510b4a6b tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.319s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance destroyed successfully.
Nov 13 23:24:48 user nova-compute[75307]: INFO nova.compute.manager [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Detaching volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:24:48 user nova-compute[75307]: INFO nova.virt.block_device [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attempting to driver detach volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168 from mountpoint /dev/vdb
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Attempting to detach device vdb from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:48 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:48 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:24:48 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:24:48 user nova-compute[75307]:   <serial>5bb0dbe6-7f66-4e20-9218-509ff7cb5168</serial>
Nov 13 23:24:48 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:24:48 user nova-compute[75307]: </disk>
Nov 13 23:24:48 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully detached device vdb from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the persistent domain config.
Nov 13 23:24:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b7355e-c749-4183-b554-afcfea4f52ae]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:24:48 user nova-compute[75307]: No targets found.
Nov 13 23:24:48 user nova-compute[75307]: iSNS:
Nov 13 23:24:48 user nova-compute[75307]: No targets found.
Nov 13 23:24:48 user nova-compute[75307]: STATIC:
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:24:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:48 user nova-compute[75307]: FIRMWARE:
Nov 13 23:24:48 user nova-compute[75307]: No targets found.
Nov 13 23:24:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:24:48 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:24:48 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4882898-b2b6-466d-b155-44c6c9ec497d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc041a4-a23c-4dd4-8d43-4ee6f2bbb56e]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:49 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:49 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:49 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34775510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f77cd4-1b95-433b-bd99-1630dabfa59f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba49f08-c048-43e0-9184-5135dfa7e75e]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[987ca802-89df-4259-91fa-838ef39c5700]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd352dd6-4991-4b40-ab0f-f0259fb6d015]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c884e142-4883-4f10-948d-f9642c5e8dee]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[801c9051-ac49-4051-93cb-2b1ffa86ed04]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]
Nov 13 23:24:49 user nova-compute[75307]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:49 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa84739-556d-4a2d-89da-d7107c422160]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== disconnect_volume: return (316ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:24:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance destroyed successfully.
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-ServerActionsTestOtherA-server-1834134784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:24:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc168db1-3a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=007d31ae-faa4-403c-a96d-866acce71ac3) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:50 user nova-compute[75307]: INFO os_vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a')
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:50 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f338852a-d210-4e62-8ea6-fa9ca4153dd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:24:50 user nova-compute[75307]: No targets found.
Nov 13 23:24:50 user nova-compute[75307]: iSNS:
Nov 13 23:24:50 user nova-compute[75307]: No targets found.
Nov 13 23:24:50 user nova-compute[75307]: STATIC:
Nov 13 23:24:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:24:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:24:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:24:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:24:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:50 user nova-compute[75307]: FIRMWARE:
Nov 13 23:24:50 user nova-compute[75307]: No targets found.
Nov 13 23:24:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:24:50 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:24:50 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccf605b-e7ae-4ab0-b3e8-06c22cd3fd11]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeee750-a4a1-4d8a-9404-21ab45ffb4e3]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:50 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3cf13b50>, {}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Disconnecting from: [] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== disconnect_volume: return (95ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:24:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Deleting instance files /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0_del
Nov 13 23:24:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Deletion of /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0_del complete
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:50 user nova-compute[75307]: WARNING nova.compute.manager [req-7ed5cd9e-9c52-47f4-9e2b-14e2499e929a req-8cb0d15e-5665-4d48-a1f7-26441878f415 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state active and task_state rebuilding.
Nov 13 23:24:50 user nova-compute[75307]: INFO nova.virt.block_device [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Booting with volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168 at /dev/vdb
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.utils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d24087-7979-4472-81b1-c09bb5f027da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7082f90d-594d-46bf-bc0b-bd3ddf8a3d7e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421f8b2-3fc7-4c64-aae3-7f9f6c4c1ed7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[19cafe6a-c40a-4b55-99b1-b54398250f4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:50 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fcba1d-4e10-45be-b2ad-3727bd18f7c2]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG os_brick.utils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:50 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating existing volume attachment record: b711b0b9-9391-4bcd-a824-1cf306437f00 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:51 user nova-compute[75307]: INFO nova.compute.manager [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attaching volume 9df46daf-79fc-4e56-91dc-a8fed01ef9db to /dev/vdc
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.utils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c561dc63-4240-4b1b-aafa-c48b66727e38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f773a7-368c-4298-b4de-8232a52014fa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1edd39-5616-4c30-a1a1-ed05c333b2eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[06346302-3afa-4630-99c6-1e6ed90f5c49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:24:51 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d660a1-b72f-41ee-a33f-a95c1760c301]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.utils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating existing volume attachment record: ac17f36d-7dbf-42c7-898b-a8d050da7f56 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:24:51 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c6b7203a-cce3-452a-9002-10011310b3e2 is timed out.
Nov 13 23:24:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Successfully detached device vdb from instance c6b7203a-cce3-452a-9002-10011310b3e2 from the live domain config.
Nov 13 23:24:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DoqhLCQr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:51 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d82b3b8-7c0e-468c-bb8d-249cddc55381]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:24:51 user nova-compute[75307]: No targets found.
Nov 13 23:24:51 user nova-compute[75307]: iSNS:
Nov 13 23:24:51 user nova-compute[75307]: No targets found.
Nov 13 23:24:51 user nova-compute[75307]: STATIC:
Nov 13 23:24:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:24:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:24:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04
Nov 13 23:24:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:24:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:51 user nova-compute[75307]: FIRMWARE:
Nov 13 23:24:51 user nova-compute[75307]: No targets found.
Nov 13 23:24:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:24:51 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:24:51 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[69791b24-bf61-48a4-8fd5-e1fc33110cc6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c12c2b-3222-4847-8287-34b32682b056]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:51 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb45a24af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7b703b-e257-42eb-b7f5-f11636f13014]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf35130-d2f6-4d9c-afb7-7fc93519ebcc]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b1f64d-2cff-4c04-bf1c-676b1b162d06]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e75fcb3-65ba-4b1e-aa7f-61a67bca25ce]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e41404-ba69-4ec4-9a59-fd4a77e44446]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32d56eb-5237-41ca-b877-a501b1959752]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260]
Nov 13 23:24:52 user nova-compute[75307]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70d9cf58-3652-4ef6-9707-8523ea18eb04 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[038f46bb-ea1a-45b7-8acf-35806cc4ea48]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] <== disconnect_volume: return (317ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:24:52 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 is timed out.
Nov 13 23:24:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully detached device vdb from instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 from the live domain config.
Nov 13 23:24:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhyBeKdQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:52 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f2b3b-6939-4795-9eb0-e23c5d918b56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:24:52 user nova-compute[75307]: No targets found.
Nov 13 23:24:52 user nova-compute[75307]: iSNS:
Nov 13 23:24:52 user nova-compute[75307]: No targets found.
Nov 13 23:24:52 user nova-compute[75307]: STATIC:
Nov 13 23:24:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf
Nov 13 23:24:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:24:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:24:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:24:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:24:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:24:52 user nova-compute[75307]: FIRMWARE:
Nov 13 23:24:52 user nova-compute[75307]: No targets found.
Nov 13 23:24:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:24:52 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:24:52 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[caab10cd-65af-49b3-870c-40cd361d5db2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[08556f70-ad55-4f1a-9817-1083d638322e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:52 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c162950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bd9171-0af2-4432-b032-894d46437e83]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c30eb1-de29-4dad-a739-9885ad58768a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c0c8c1-f703-4f1e-bbdd-6f49c79ff5cc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[db467b0d-92c2-491a-a5b2-97aec6dd556d]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f53414-2e32-4ebc-97a6-66847ac39461]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a28efe-1330-4b7f-8a1b-f88c6a71830a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260]
Nov 13 23:24:52 user nova-compute[75307]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4dc09455-9977-4d89-bdea-923ea31dd8bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[752c27ef-8c12-4233-903b-dafbf8b7ee72]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== disconnect_volume: return (307ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG nova.objects.instance [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'flavor' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ed43afe-18a1-4adf-85e1-d75c65dff7ae tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.606s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:24:53 user nova-compute[75307]: INFO nova.compute.claims [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Claim successful on node user
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.objects.instance [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79ef111f-26d5-43ff-b7a5-b9c113c44f51 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.038s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:24:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:24:53 user nova-compute[75307]: DEBUG nova.policy [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19d8c9bb553d4995bc62521ef2b8bf0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e387a1f37b944329bb8f097e8f4ec56b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:24:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Creating image(s)
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "/opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "/opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "/opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk 1073741824" returned: 0 in 0.111s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Successfully created port: 295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Cannot resize image /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Ensure instance console log exists: /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:24:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Creating image(s)
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Successfully updated port: 295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquired lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-changed-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Refreshing instance network info cache due to event network-changed-295a9e27-b825-484b-bfd9-a947cb2e8a13. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] Acquiring lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk 1073741824" returned: 0 in 0.045s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating instance_info_cache with network_info: [{"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgwsiBlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:55 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Releasing lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Instance network_info: |[{"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] Acquired lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.neutron [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Refreshing network info cache for port 295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Start _get_guest_xml network_info=[{"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:24:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc60578-be70-4355-8276-d36f4eb71f90]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:55 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-233527754',display_name='tempest-AttachVolumeTestJSON-server-233527754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-233527754',id=28,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa5wVL5UYmQCg0wanAYFgHh0f9CP5o1QTmVv4DVgCOZvEwCFkN7a3H8lFzyn+B4cspsTP0qdSQPwqiL5Y5WopmP4RGuYzwQ+Lsa9SrkJHcJeqyhVnSLy5KMcJhFSp0rA==',key_name='tempest-keypair-972638700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-dcnnuetd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=d27f63dd-33ee-418f-90bc-297622ae340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'pci_devices' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ed9b3e-cb7c-4b2c-a97d-7c5ec2d6dd3c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db] added
Nov 13 23:24:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:24:55 user nova-compute[75307]:   <uuid>d27f63dd-33ee-418f-90bc-297622ae340b</uuid>
Nov 13 23:24:55 user nova-compute[75307]:   <name>instance-0000001c</name>
Nov 13 23:24:55 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:24:55 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:24:55 user nova-compute[75307]:   <metadata>
Nov 13 23:24:55 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:24:55 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeTestJSON-server-233527754</nova:name>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:24:55</nova:creationTime>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:24:55 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:24:55 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:owner>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:user uuid="19d8c9bb553d4995bc62521ef2b8bf0b">tempest-AttachVolumeTestJSON-1230084994-project-member</nova:user>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:project uuid="e387a1f37b944329bb8f097e8f4ec56b">tempest-AttachVolumeTestJSON-1230084994</nova:project>
Nov 13 23:24:55 user nova-compute[75307]:       </nova:owner>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:24:55 user nova-compute[75307]:       <nova:ports>
Nov 13 23:24:55 user nova-compute[75307]:         <nova:port uuid="295a9e27-b825-484b-bfd9-a947cb2e8a13">
Nov 13 23:24:55 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 13 23:24:55 user nova-compute[75307]:         </nova:port>
Nov 13 23:24:55 user nova-compute[75307]:       </nova:ports>
Nov 13 23:24:55 user nova-compute[75307]:     </nova:instance>
Nov 13 23:24:55 user nova-compute[75307]:   </metadata>
Nov 13 23:24:55 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:24:55 user nova-compute[75307]:     <system>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="serial">d27f63dd-33ee-418f-90bc-297622ae340b</entry>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="uuid">d27f63dd-33ee-418f-90bc-297622ae340b</entry>
Nov 13 23:24:55 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:24:55 user nova-compute[75307]:     </system>
Nov 13 23:24:55 user nova-compute[75307]:   </sysinfo>
Nov 13 23:24:55 user nova-compute[75307]:   <os>
Nov 13 23:24:55 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:24:55 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:24:55 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:24:55 user nova-compute[75307]:   </os>
Nov 13 23:24:55 user nova-compute[75307]:   <features>
Nov 13 23:24:55 user nova-compute[75307]:     <acpi/>
Nov 13 23:24:55 user nova-compute[75307]:     <apic/>
Nov 13 23:24:55 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:24:55 user nova-compute[75307]:   </features>
Nov 13 23:24:55 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:24:55 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:24:55 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:24:55 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:24:55 user nova-compute[75307]:   </clock>
Nov 13 23:24:55 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:24:55 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:24:55 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:24:55 user nova-compute[75307]:   </cpu>
Nov 13 23:24:55 user nova-compute[75307]:   <devices>
Nov 13 23:24:55 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:24:55 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:24:55 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk"/>
Nov 13 23:24:55 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:24:55 user nova-compute[75307]:     </disk>
Nov 13 23:24:55 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:24:55 user nova-compute[75307]:       <mac address="fa:16:3e:41:37:9d"/>
Nov 13 23:24:55 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:55 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:24:55 user nova-compute[75307]:       <target dev="tap295a9e27-b8"/>
Nov 13 23:24:55 user nova-compute[75307]:     </interface>
Nov 13 23:24:55 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:24:55 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/console.log" append="off"/>
Nov 13 23:24:55 user nova-compute[75307]:     </serial>
Nov 13 23:24:55 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:24:55 user nova-compute[75307]:     <video>
Nov 13 23:24:55 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:55 user nova-compute[75307]:     </video>
Nov 13 23:24:55 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:24:55 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:24:55 user nova-compute[75307]:     </rng>
Nov 13 23:24:55 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:24:55 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:24:55 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:24:55 user nova-compute[75307]:     </memballoon>
Nov 13 23:24:55 user nova-compute[75307]:   </devices>
Nov 13 23:24:55 user nova-compute[75307]: </domain>
Nov 13 23:24:55 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-233527754',display_name='tempest-AttachVolumeTestJSON-server-233527754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-233527754',id=28,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa5wVL5UYmQCg0wanAYFgHh0f9CP5o1QTmVv4DVgCOZvEwCFkN7a3H8lFzyn+B4cspsTP0qdSQPwqiL5Y5WopmP4RGuYzwQ+Lsa9SrkJHcJeqyhVnSLy5KMcJhFSp0rA==',key_name='tempest-keypair-972638700',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-dcnnuetd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:24:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=d27f63dd-33ee-418f-90bc-297622ae340b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_vif [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58c56545-c5ef-56aa-a538-7dbc92003be5', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f22a3a-71d1-4da7-b846-0a642967811a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap295a9e27-b8, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap295a9e27-b8, col_values=(('qos', UUID('114a7224-0f1a-4d5a-a5de-5ddbc3028242')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap295a9e27-b8, col_values=(('external_ids', {'iface-id': '295a9e27-b825-484b-bfd9-a947cb2e8a13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:37:9d', 'vm-uuid': 'd27f63dd-33ee-418f-90bc-297622ae340b'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:55 user nova-compute[75307]: INFO os_vif [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8')
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Cannot resize image /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Ensure instance console log exists: /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start _get_guest_xml network_info=[{"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9b55c5d0-375b-4f93-a986-ac8cc4bf79d0', 'attached_at': '', 'detached_at': '', 'volume_id': '5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'serial': '5bb0dbe6-7f66-4e20-9218-509ff7cb5168'}, 'delete_on_termination': False, 'attachment_id': 'b711b0b9-9391-4bcd-a824-1cf306437f00', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff6ec2d8-1081-419f-8209-8d85fdbd1ce3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgwsiBlY {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 23:24:55 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgwsiBlY" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b717f86-425c-4a5f-a564-f6c9c94b5461]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgwsiBlY'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:24:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac601998-702f-4f38-a522-f271e97795aa]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No VIF found with MAC fa:16:3e:41:37:9d, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8292568e-48f3-4eb8-b1c3-69841dde1dc9]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5f8692-2fef-4881-8504-ef0b222b3691]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260]
Nov 13 23:24:56 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68a0f68-811c-4b1d-b2a7-9205cf515b71]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d17053af-2ce8-42eb-8711-de5b367ebf01]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:56 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5de9389-9057-49bf-9bda-938c3e095297]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgwsiBlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updated VIF entry in instance network info cache for port 295a9e27-b825-484b-bfd9-a947cb2e8a13. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating instance_info_cache with network_info: [{"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:24:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6347ed5f-c5cb-4ce2-ac5d-02e63a9dade1 req-740c4868-f99a-4f9f-a3dd-2e29e12c5933 service nova] Releasing lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== connect_volume: return (1424ms) {'type': 'block', 'scsi_wwn': '23432623835383133', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432623835383133', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.187s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:57 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:24:57 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1733c9-7017-419e-bbc0-4a0a73f25dd3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:24:57 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:24:57 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:57 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:24:57 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:24:57 user nova-compute[75307]:   <serial>9df46daf-79fc-4e56-91dc-a8fed01ef9db</serial>
Nov 13 23:24:57 user nova-compute[75307]: </disk>
Nov 13 23:24:57 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2346bbd-72ae-4d35-b4d1-a42966aaadf8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168] added
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9549d69d-1d7a-4e86-b449-1d61e3267ecb]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[785cd314-d0e3-46ce-87cb-53301cb42672]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovstHaVA {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ovstHaVA" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[27156082-4cda-441e-8078-7894a3a58153]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ovstHaVA'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[030cc563-de07-40f6-b42e-75b8bd6f57be]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6651852d-c8fd-4770-a1ba-cd723345726e]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a23ffa2-277d-4d49-ba0b-8b731e431f15]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]
Nov 13 23:24:57 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef14eab-12b4-46b1-85ef-41d12c622e82]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d938761a-f697-4267-b8ec-ebbc64a8df89]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:24:57 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:24:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0978aa6d-2b89-4436-ba95-490c417a2a74]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] No waiting events found dispatching network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:57 user nova-compute[75307]: WARNING nova.compute.manager [req-7fb64a31-6e49-45be-b88d-aa8658b0b3ef req-3c4fa156-0ed6-4b42-baab-98a650eab34d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received unexpected event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 for instance with vm_state building and task_state spawning.
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] No VIF found with MAC fa:16:3e:7c:05:80, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bcde417-dc17-4194-ac46-91c893dad232 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.649s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== connect_volume: return (2539ms) {'type': 'block', 'scsi_wwn': '26235616233343864', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235616233343864', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-ServerActionsTestOtherA-server-1834134784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:24:58 user nova-compute[75307]:   <uuid>9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</uuid>
Nov 13 23:24:58 user nova-compute[75307]:   <name>instance-00000019</name>
Nov 13 23:24:58 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:24:58 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:24:58 user nova-compute[75307]:   <metadata>
Nov 13 23:24:58 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:24:58 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherA-server-1834134784</nova:name>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:24:55</nova:creationTime>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:24:58 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:24:58 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:owner>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:user uuid="7b605f62d134435896eb5dce0b48d51c">tempest-ServerActionsTestOtherA-708902499-project-member</nova:user>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:project uuid="f4260b68885d4f5ebfa01306bf64a9b9">tempest-ServerActionsTestOtherA-708902499</nova:project>
Nov 13 23:24:58 user nova-compute[75307]:       </nova:owner>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:24:58 user nova-compute[75307]:       <nova:ports>
Nov 13 23:24:58 user nova-compute[75307]:         <nova:port uuid="cc168db1-3a03-4452-bdd0-559e9e53e4d6">
Nov 13 23:24:58 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:24:58 user nova-compute[75307]:         </nova:port>
Nov 13 23:24:58 user nova-compute[75307]:       </nova:ports>
Nov 13 23:24:58 user nova-compute[75307]:     </nova:instance>
Nov 13 23:24:58 user nova-compute[75307]:   </metadata>
Nov 13 23:24:58 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:24:58 user nova-compute[75307]:     <system>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="serial">9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</entry>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="uuid">9b55c5d0-375b-4f93-a986-ac8cc4bf79d0</entry>
Nov 13 23:24:58 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:24:58 user nova-compute[75307]:     </system>
Nov 13 23:24:58 user nova-compute[75307]:   </sysinfo>
Nov 13 23:24:58 user nova-compute[75307]:   <os>
Nov 13 23:24:58 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:24:58 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:24:58 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:24:58 user nova-compute[75307]:   </os>
Nov 13 23:24:58 user nova-compute[75307]:   <features>
Nov 13 23:24:58 user nova-compute[75307]:     <acpi/>
Nov 13 23:24:58 user nova-compute[75307]:     <apic/>
Nov 13 23:24:58 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:24:58 user nova-compute[75307]:   </features>
Nov 13 23:24:58 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:24:58 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:24:58 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:24:58 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:24:58 user nova-compute[75307]:   </clock>
Nov 13 23:24:58 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:24:58 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:24:58 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:24:58 user nova-compute[75307]:   </cpu>
Nov 13 23:24:58 user nova-compute[75307]:   <devices>
Nov 13 23:24:58 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:24:58 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:24:58 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk"/>
Nov 13 23:24:58 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:     </disk>
Nov 13 23:24:58 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:24:58 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:58 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:24:58 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:       <serial>5bb0dbe6-7f66-4e20-9218-509ff7cb5168</serial>
Nov 13 23:24:58 user nova-compute[75307]:     </disk>
Nov 13 23:24:58 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:24:58 user nova-compute[75307]:       <mac address="fa:16:3e:19:fa:e1"/>
Nov 13 23:24:58 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:24:58 user nova-compute[75307]:       <target dev="tapcc168db1-3a"/>
Nov 13 23:24:58 user nova-compute[75307]:     </interface>
Nov 13 23:24:58 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:24:58 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/console.log" append="off"/>
Nov 13 23:24:58 user nova-compute[75307]:     </serial>
Nov 13 23:24:58 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:24:58 user nova-compute[75307]:     <video>
Nov 13 23:24:58 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:     </video>
Nov 13 23:24:58 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:24:58 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:24:58 user nova-compute[75307]:     </rng>
Nov 13 23:24:58 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:24:58 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:24:58 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:24:58 user nova-compute[75307]:     </memballoon>
Nov 13 23:24:58 user nova-compute[75307]:   </devices>
Nov 13 23:24:58 user nova-compute[75307]: </domain>
Nov 13 23:24:58 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-ServerActionsTestOtherA-server-1834134784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:24:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG os_vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '016b84f2-b927-5f26-b89a-453eb0d242b2', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcc168db1-3a, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcc168db1-3a, col_values=(('qos', UUID('16f9241a-a76d-4303-ba02-094163416d18')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcc168db1-3a, col_values=(('external_ids', {'iface-id': 'cc168db1-3a03-4452-bdd0-559e9e53e4d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:fa:e1', 'vm-uuid': '9b55c5d0-375b-4f93-a986-ac8cc4bf79d0'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:24:58 user nova-compute[75307]: INFO os_vif [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a')
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:19:fa:e1, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:58 user nova-compute[75307]: INFO nova.compute.manager [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Detaching volume 9df46daf-79fc-4e56-91dc-a8fed01ef9db
Nov 13 23:24:58 user nova-compute[75307]: INFO nova.virt.block_device [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attempting to driver detach volume 9df46daf-79fc-4e56-91dc-a8fed01ef9db from mountpoint /dev/vdc
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Attempting to detach device vdc from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:58 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:58 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:24:58 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:   <serial>9df46daf-79fc-4e56-91dc-a8fed01ef9db</serial>
Nov 13 23:24:58 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:24:58 user nova-compute[75307]: </disk>
Nov 13 23:24:58 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully detached device vdc from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the persistent domain config.
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:24:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:24:58 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:24:58 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:24:58 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:24:58 user nova-compute[75307]:   <serial>9df46daf-79fc-4e56-91dc-a8fed01ef9db</serial>
Nov 13 23:24:58 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:24:58 user nova-compute[75307]: </disk>
Nov 13 23:24:58 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:24:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] No waiting events found dispatching network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:24:59 user nova-compute[75307]: WARNING nova.compute.manager [req-4a1b7226-15b8-4a2a-8349-a153f10a4435 req-c35b06d1-1b81-4e2c-88d2-d2fab71783be service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received unexpected event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 for instance with vm_state building and task_state spawning.
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:25:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Instance spawned successfully.
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'flavor' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:00 user nova-compute[75307]: INFO nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Took 6.12 seconds to spawn the instance on the hypervisor.
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:00 user nova-compute[75307]: INFO nova.compute.manager [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Attaching volume 634bc8fe-fec1-430f-8083-7721767f4bea to /dev/vdb
Nov 13 23:25:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:00 user nova-compute[75307]: INFO nova.compute.manager [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Took 7.04 seconds to build instance.
Nov 13 23:25:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2fb09a61-f54d-42bf-8f3d-08d779fa5646 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.184s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.utils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc477de-c49b-4802-94f2-8fbf0fbcd6c6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db8208-b9be-4315-b16b-c0008f448aa5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f45b1c3-1c7b-4b2f-a9cf-030a42164057]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33e2aee-bdf5-4f63-9bc7-36bb9bf40ad4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:00 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2529848-b3e2-4f36-be03-a43f6ab37e46]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG os_brick.utils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating existing volume attachment record: e12c6d81-4c84-40e7-86fb-f6c33a966ef4 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:00 user nova-compute[75307]: WARNING nova.compute.manager [req-e3d08106-366f-4fcc-af97-5564c79f8dd8 req-1d6dbe1d-17b8-461b-b546-5572a39e6efa service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 23:25:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:25:02 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance spawned successfully.
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:02 user nova-compute[75307]: WARNING nova.compute.manager [req-e284301f-1421-4d72-a1fb-0d41e0bbd233 req-f7dcbaac-dbf4-4de1-b587-652bca0cb4c0 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state active and task_state rebuild_spawning.
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75307) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 13 23:25:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e07397f3-4db9-4cf9-84ab-27eb41eee8f2 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.087s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:05 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeefe451-8a32-4f9f-a5a9-144c7ddb7e31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:25:05 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26fb788-fa1b-44dc-adfb-ae4b57fb68ae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48117447-0ab9-41bf-8d5e-6335d1f9657f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9e9ee-628d-4b22-b5f0-84298cd14a7c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c00677b-6ab3-4216-8695-d28e63ac26a1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrhcmVOL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9737b0a7-6dfc-432d-97de-f066dc0de304]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdbd151-ea01-4940-828a-3a8b2c5f914a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8639e79c-1efa-4150-ab7d-26b448c05d43]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:25:05 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[549af0ec-a7e1-4a69-96a7-b3478e71a498]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa031ea-5929-4cb1-b61e-e6ac5a95b299]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:05 user nova-compute[75307]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca31109-6a3f-4d31-bf2f-db86de0ba428]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.objects.instance [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'flavor' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:25:06 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:06 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:25:06 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:06 user nova-compute[75307]:   <serial>634bc8fe-fec1-430f-8083-7721767f4bea</serial>
Nov 13 23:25:06 user nova-compute[75307]: </disk>
Nov 13 23:25:06 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No VIF found with MAC fa:16:3e:0a:ba:fe, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:25:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-caf8ead8-7bb1-497d-a8aa-68c7b58320d1 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.771s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:09 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Stashing vm_state: active {{(pid=75307) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 23:25:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:09 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:25:09 user nova-compute[75307]: INFO nova.compute.claims [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Claim successful on node user
Nov 13 23:25:09 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating resource usage from migration ee86dc33-f210-41e7-bebf-82d23b329579
Nov 13 23:25:10 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.865s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:10 user nova-compute[75307]: INFO nova.compute.manager [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Migrating
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:10 user nova-compute[75307]: INFO nova.compute.rpcapi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Starting migrate_disk_and_power_off {{(pid=75307) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:11 user nova-compute[75307]: WARNING nova.compute.manager [req-72e31f60-428b-4c1d-87c8-1656df8dc14d req-d74faa82-606c-4a8a-8077-6df8accd065a service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state active and task_state resize_migrating.
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance destroyed successfully.
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:25:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG os_vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e669d9-28, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61d4dfed-fd10-450e-8e0c-4f00ba2f26a8) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:11 user nova-compute[75307]: INFO os_vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:25:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:11 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[442c1a5d-bd72-497f-89d0-80be7448dcb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:25:12 user nova-compute[75307]: No targets found.
Nov 13 23:25:12 user nova-compute[75307]: iSNS:
Nov 13 23:25:12 user nova-compute[75307]: No targets found.
Nov 13 23:25:12 user nova-compute[75307]: STATIC:
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db
Nov 13 23:25:12 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:12 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:12 user nova-compute[75307]: FIRMWARE:
Nov 13 23:25:12 user nova-compute[75307]: No targets found.
Nov 13 23:25:12 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:25:12 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:25:12 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[912a93cf-093e-47d7-84c4-556215e54b3e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2680acf-c3a0-4961-9823-c37e116d34f6]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:12 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:12 user nova-compute[75307]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:12 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c0d17e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f0d9b9-c2d2-4300-8458-af998ea6df48]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[183d6b7f-2e3f-4275-b11d-bcd2704c16f1]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62fce44-2fac-40cd-a512-b9f4b4aad69b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.037s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e683f746-b59f-44ee-8062-e85d8f10c4e7]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f563d2-f93b-4547-9947-79499654df4d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e866b7e8-184b-4c43-ae48-36a79821d725]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:25:12 user nova-compute[75307]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:12 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e859f6-8338-48fe-b34f-b6170e64bf28]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== disconnect_volume: return (354ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_resize/disk /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "cp -r /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_resize/disk /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk" returned: 0 in 0.376s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_resize/disk.info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk.info {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "cp -r /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_resize/disk.info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk.info" returned: 0 in 0.033s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:13 user nova-compute[75307]: WARNING nova.compute.manager [req-38a9e7ba-655c-4329-9596-a87831bf52e3 req-e63fa859-f7d7-4499-a751-0ab4608c4967 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state active and task_state resize_migrating.
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Port 47e669d9-2897-4d52-8611-36afbf74c293 binding to destination host user is already ACTIVE {{(pid=75307) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG os_brick.utils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b99ce-c6d9-4dee-990a-d2fe67a7054d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd933f3c-c26f-4e3b-9c69-e13d753fc8e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7237MB free_disk=25.23385238647461GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb1425b-2493-419f-aaad-91b9c09d32aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c879d2-feac-43b9-aafb-3e05f93acc42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:16 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cb5a47-410f-4783-aa9c-a575f1b4a447]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.utils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== get_connector_properties: return (483ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Applying migration context for instance a90dad03-c454-4728-a5a6-cf5759a41ed7 as it has an incoming, in-progress migration ee86dc33-f210-41e7-bebf-82d23b329579. Migration status is post-migrating {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 23:25:16 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating resource usage from migration ee86dc33-f210-41e7-bebf-82d23b329579
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c6b7203a-cce3-452a-9002-10011310b3e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ee73e99a-6a19-4ea0-add9-54356a61f5b0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d27f63dd-33ee-418f-90bc-297622ae340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Migration ee86dc33-f210-41e7-bebf-82d23b329579 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:16 user nova-compute[75307]: INFO nova.compute.manager [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attaching volume 86ed7175-086b-4f29-a50c-6870e375e228 to /dev/vdb
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.842s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.utils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[529d9655-084f-4850-80e0-cd3d2e3fca2f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63500e48-5598-439d-8b28-bf8a5ca410c9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[110d2767-7e15-414c-9239-5fed2b2631c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2490b30d-c490-4044-9009-76937743c58c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:25:16 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:25:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[13edf528-2ef7-48fa-b347-7b7da954b524]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG os_brick.utils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating existing volume attachment record: 93a5c244-9ad5-4655-ba84-4330df700612 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:25:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:25:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:25:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 is timed out.
Nov 13 23:25:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully detached device vdc from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the live domain config.
Nov 13 23:25:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgwsiBlY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:19 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed6d2a-884f-45bd-b4c2-fb0c37f8b844]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:25:19 user nova-compute[75307]: No targets found.
Nov 13 23:25:19 user nova-compute[75307]: iSNS:
Nov 13 23:25:19 user nova-compute[75307]: No targets found.
Nov 13 23:25:19 user nova-compute[75307]: STATIC:
Nov 13 23:25:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:25:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:25:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:25:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:25:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db
Nov 13 23:25:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:19 user nova-compute[75307]: FIRMWARE:
Nov 13 23:25:19 user nova-compute[75307]: No targets found.
Nov 13 23:25:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:25:19 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:25:19 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[834c1758-9c0a-4943-8da0-ca1300731f49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c177b3-3355-490f-bec7-29c480856431]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db (non-flash)
Nov 13 23:25:19 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c3f1c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26b1292-487d-41e4-8071-732b7d03df3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[91039d76-ca73-4c64-93c1-a77470c10508]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3171e1d-371b-4f2a-b2db-b7e9ed6ca0e1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d6d968-3e0a-4eb9-9a00-621f53171568]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68251934-ed76-4fcb-a290-e6562d2b930c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53512d35-d406-4e15-911d-77d0858994b9]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260]
Nov 13 23:25:19 user nova-compute[75307]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9df46daf-79fc-4e56-91dc-a8fed01ef9db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56cb195-e1db-4303-b2f3-7f95b6bfa0ad]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== disconnect_volume: return (335ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Starting finish_migration {{(pid=75307) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:25:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Creating image(s)
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk. size=21474836480 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-91f087fd-edec-441b-bab6-cf7ca50c8e10 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.117s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk 21474836480 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk 21474836480" returned: 0 in 0.046s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Ensure instance console log exists: /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start _get_guest_xml network_info=[{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a90dad03-c454-4728-a5a6-cf5759a41ed7', 'attached_at': '2023-11-13T23:25:20.000000', 'detached_at': '', 'volume_id': '634bc8fe-fec1-430f-8083-7721767f4bea', 'serial': '634bc8fe-fec1-430f-8083-7721767f4bea'}, 'delete_on_termination': False, 'attachment_id': 'cff7b076-2ab9-4b6e-9934-5e381167b4eb', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:25:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:21 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[333a36b1-63a5-4aef-9365-f1c1daf49815]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:25:21 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af4dfc1-40c7-4a0f-9bbc-ee34d103fb1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1819e2d0-e095-4bb5-9844-bbb23013845f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[63472717-ab4b-401d-8781-f07247e1e722]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e65f324-1b77-45c2-8f8e-ee8d60aa5718]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrhcmVOL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6b476a-f01d-4c3c-8acb-2234ef25d5db]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12244e9-e68b-4290-8cb0-2f3ae43d2fbc]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e548292d-8cab-4bb2-b7a3-342bde754045]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:25:21 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedb76ab-7092-4708-9525-98e456519bbe]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNQkqpIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd41deb9-d8f7-4954-858d-025a81952a4a]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:21 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f6b802-616e-41ef-8272-e6a1740712d0]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:21 user nova-compute[75307]: INFO nova.compute.manager [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Terminating instance
Nov 13 23:25:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:25:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-c78a81bc-36a6-4259-8bad-425a868ee800 req-9b18f9fe-8153-4068-a1c9-ee1c2e19a894 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-unplugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.077s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:22 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95502f3-1162-4c4b-9896-4257f933dcf7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:25:22 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:25:22 user nova-compute[75307]:   <uuid>a90dad03-c454-4728-a5a6-cf5759a41ed7</uuid>
Nov 13 23:25:22 user nova-compute[75307]:   <name>instance-00000016</name>
Nov 13 23:25:22 user nova-compute[75307]:   <memory>2097152</memory>
Nov 13 23:25:22 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:25:22 user nova-compute[75307]:   <metadata>
Nov 13 23:25:22 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:25:22 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherB-server-619339730</nova:name>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:25:21</nova:creationTime>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:flavor name="m1.small">
Nov 13 23:25:22 user nova-compute[75307]:         <nova:memory>2048</nova:memory>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:disk>20</nova:disk>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:25:22 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:owner>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:user uuid="025c402ce1bc4de7a718a2b5e119b4ae">tempest-ServerActionsTestOtherB-391883818-project-member</nova:user>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:project uuid="9031887798954fab9ea96c7ce9c30984">tempest-ServerActionsTestOtherB-391883818</nova:project>
Nov 13 23:25:22 user nova-compute[75307]:       </nova:owner>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:25:22 user nova-compute[75307]:       <nova:ports>
Nov 13 23:25:22 user nova-compute[75307]:         <nova:port uuid="47e669d9-2897-4d52-8611-36afbf74c293">
Nov 13 23:25:22 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:25:22 user nova-compute[75307]:         </nova:port>
Nov 13 23:25:22 user nova-compute[75307]:       </nova:ports>
Nov 13 23:25:22 user nova-compute[75307]:     </nova:instance>
Nov 13 23:25:22 user nova-compute[75307]:   </metadata>
Nov 13 23:25:22 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:25:22 user nova-compute[75307]:     <system>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="serial">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="uuid">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:25:22 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:25:22 user nova-compute[75307]:     </system>
Nov 13 23:25:22 user nova-compute[75307]:   </sysinfo>
Nov 13 23:25:22 user nova-compute[75307]:   <os>
Nov 13 23:25:22 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:25:22 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:25:22 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:25:22 user nova-compute[75307]:   </os>
Nov 13 23:25:22 user nova-compute[75307]:   <features>
Nov 13 23:25:22 user nova-compute[75307]:     <acpi/>
Nov 13 23:25:22 user nova-compute[75307]:     <apic/>
Nov 13 23:25:22 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:25:22 user nova-compute[75307]:   </features>
Nov 13 23:25:22 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:25:22 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:25:22 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:25:22 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:25:22 user nova-compute[75307]:   </clock>
Nov 13 23:25:22 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:25:22 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:25:22 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:25:22 user nova-compute[75307]:   </cpu>
Nov 13 23:25:22 user nova-compute[75307]:   <devices>
Nov 13 23:25:22 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:25:22 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:25:22 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk"/>
Nov 13 23:25:22 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:25:22 user nova-compute[75307]:     </disk>
Nov 13 23:25:22 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:25:22 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:22 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:25:22 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:25:22 user nova-compute[75307]:       <serial>634bc8fe-fec1-430f-8083-7721767f4bea</serial>
Nov 13 23:25:22 user nova-compute[75307]:     </disk>
Nov 13 23:25:22 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:25:22 user nova-compute[75307]:       <mac address="fa:16:3e:0a:ba:fe"/>
Nov 13 23:25:22 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:25:22 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:25:22 user nova-compute[75307]:       <target dev="tap47e669d9-28"/>
Nov 13 23:25:22 user nova-compute[75307]:     </interface>
Nov 13 23:25:22 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:25:22 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/console.log" append="off"/>
Nov 13 23:25:22 user nova-compute[75307]:     </serial>
Nov 13 23:25:22 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:25:22 user nova-compute[75307]:     <video>
Nov 13 23:25:22 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:25:22 user nova-compute[75307]:     </video>
Nov 13 23:25:22 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:25:22 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:25:22 user nova-compute[75307]:     </rng>
Nov 13 23:25:22 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:25:22 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:25:22 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:25:22 user nova-compute[75307]:     </memballoon>
Nov 13 23:25:22 user nova-compute[75307]:   </devices>
Nov 13 23:25:22 user nova-compute[75307]: </domain>
Nov 13 23:25:22 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:21:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:25:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-868270830-network", "vif_mac": "fa:16:3e:0a:ba:fe"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3431e9de-0c15-415f-974e-d6922765fa2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228] added
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1118dd7-4706-51ac-96ac-8a93c70820ab', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b9467e-efb9-4566-964e-2d85583938b3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e669d9-28, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e669d9-28, col_values=(('qos', UUID('c6ff039c-c426-4029-9736-5035cc6e2efe')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e669d9-28, col_values=(('external_ids', {'iface-id': '47e669d9-2897-4d52-8611-36afbf74c293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:ba:fe', 'vm-uuid': 'a90dad03-c454-4728-a5a6-cf5759a41ed7'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[03101368-9fa3-4ed0-aa2b-7c55acf30c6e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: INFO os_vif [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNQkqpIi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNQkqpIi" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd7f761-37be-4b9d-be5f-b63d36a900ad]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sNQkqpIi'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab2b258-84f5-464d-a798-9b5753fab8e6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[596f0c75-ceb7-4253-ab0e-7998af3f66d8]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] No VIF found with MAC fa:16:3e:0a:ba:fe, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:25:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Instance destroyed successfully.
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.objects.instance [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lazy-loading 'resources' on Instance uuid c6b7203a-cce3-452a-9002-10011310b3e2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:18:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1092360754',display_name='tempest-ServerStableDeviceRescueTest-server-1092360754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1092360754',id=15,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNO1CcKJSxuglMb7gdJ5JBc1gv7mrL0AV9DJCjmp/3v0oY+d9hMUoCvALlkJk0hLvSY8DI1HjcDiIQiUH75CDilOfY7kn9V5A2Irk9in+iVma9dnsMUlICdGug0s/BtaOQ==',key_name='tempest-keypair-315055213',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1ec4693b70f449ae8aec526a751ceda8',ramdisk_id='',reservation_id='r-h936wvew',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-236265535',owner_user_name='tempest-ServerStableDeviceRescueTest-236265535-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:24:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0ad50de29ef84625a9b23c295d97484d',uuid=c6b7203a-cce3-452a-9002-10011310b3e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converting VIF {"id": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "address": "fa:16:3e:fa:1a:ce", "network": {"id": "f8b6c7a8-1717-40f4-b601-aacbe3a8246b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-93318466-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1ec4693b70f449ae8aec526a751ceda8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a7006d-5f", "ovs_interfaceid": "a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_vif [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[709af912-2acf-4e8a-abc0-2271a5a69a87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260]
Nov 13 23:25:22 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a7006d-5f, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=af2e7e20-e271-4753-ae08-4b6fd4b8b3a6) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a261bb1c-3afa-48e2-9b9c-d450e4e22877]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: INFO os_vif [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fa:1a:ce,bridge_name='br-int',has_traffic_filtering=True,id=a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b,network=Network(f8b6c7a8-1717-40f4-b601-aacbe3a8246b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a7006d-5f')
Nov 13 23:25:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Deleting instance files /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2_del
Nov 13 23:25:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Deletion of /opt/stack/data/nova/instances/c6b7203a-cce3-452a-9002-10011310b3e2_del complete
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.124s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0e8b81-73e1-442c-bcbf-eddc920f7e66]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:22 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.469s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d10b302-3425-4c39-b2c3-98df0a116e95]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:25:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNQkqpIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:25:23 user nova-compute[75307]: INFO nova.compute.manager [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Took 1.09 seconds to destroy the instance on the hypervisor.
Nov 13 23:25:23 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:23 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Took 0.81 seconds to deallocate network for instance.
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-5fdbbc32-03e6-4f95-b98e-1e86257a22b4 req-cb562085-9412-40e3-9f7d-13b561fcbc12 service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-deleted-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== connect_volume: return (2581ms) {'type': 'block', 'scsi_wwn': '23462336561336130', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23462336561336130', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG nova.objects.instance [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:25:24 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:24 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:25:24 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:24 user nova-compute[75307]:   <serial>86ed7175-086b-4f29-a50c-6870e375e228</serial>
Nov 13 23:25:24 user nova-compute[75307]: </disk>
Nov 13 23:25:24 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.491s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:24 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Deleted allocations for instance c6b7203a-cce3-452a-9002-10011310b3e2
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-00917180-0ea7-4ecf-8dcd-58240a5e723f tempest-ServerStableDeviceRescueTest-236265535 tempest-ServerStableDeviceRescueTest-236265535-project-member] Lock "c6b7203a-cce3-452a-9002-10011310b3e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.740s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] Acquiring lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] Lock "c6b7203a-cce3-452a-9002-10011310b3e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] No waiting events found dispatching network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:24 user nova-compute[75307]: WARNING nova.compute.manager [req-f6ff29d9-68dd-461d-8a48-77b35c37e29f req-d66707a7-3b17-40c5-b56c-e2faa8e74e8f service nova] [instance: c6b7203a-cce3-452a-9002-10011310b3e2] Received unexpected event network-vif-plugged-a0a7006d-5f9d-4fb2-b1f8-7eab4fb9057b for instance with vm_state deleted and task_state None.
Nov 13 23:25:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] No VIF found with MAC fa:16:3e:80:4b:90, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:25:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-332a0a2b-7b0c-40a4-8a08-641736033d4a tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.134s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:25:25 user nova-compute[75307]: INFO nova.compute.manager [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] instance snapshotting
Nov 13 23:25:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Beginning live snapshot process
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json -f qcow2" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:25 user nova-compute[75307]: WARNING nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state active and task_state resize_finish.
Nov 13 23:25:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:25 user nova-compute[75307]: WARNING nova.compute.manager [req-753ae10f-013e-4732-ac16-c67e16aea19f req-8d8c7a76-eefb-4f92-bbb1-0878a045e142 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state active and task_state resize_finish.
Nov 13 23:25:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02.delta 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02.delta 1073741824" returned: 0 in 0.056s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 23:25:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:25:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance running successfully.
Nov 13 23:25:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Failed to set time: agent not configured {{(pid=75307) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 23:25:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6f84cd8d-15e9-4f8b-8729-a375eee6ebc4 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] finish_migration finished successfully. {{(pid=75307) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 23:25:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] COPY block job progress, current cursor: 68485120 final cursor: 75563008 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:27 user nova-compute[75307]: INFO nova.compute.manager [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Detaching volume 86ed7175-086b-4f29-a50c-6870e375e228
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:25:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 23:25:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:27 user nova-compute[75307]: INFO nova.virt.block_device [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Attempting to driver detach volume 86ed7175-086b-4f29-a50c-6870e375e228 from mountpoint /dev/vdb
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Attempting to detach device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:25:27 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:27 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:25:27 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:27 user nova-compute[75307]:   <serial>86ed7175-086b-4f29-a50c-6870e375e228</serial>
Nov 13 23:25:27 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:25:27 user nova-compute[75307]: </disk>
Nov 13 23:25:27 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:25:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the persistent domain config.
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:25:27 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:27 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:25:27 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:27 user nova-compute[75307]:   <serial>86ed7175-086b-4f29-a50c-6870e375e228</serial>
Nov 13 23:25:27 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:25:27 user nova-compute[75307]: </disk>
Nov 13 23:25:27 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:25:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02.delta /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02.delta /opt/stack/data/nova/instances/snapshots/tmp9crkn19d/2dde82c51c1d434b91ae7b1010fdba02" returned: 0 in 0.379s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Snapshot extracted, beginning image upload
Nov 13 23:25:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-changed-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Refreshing instance network info cache due to event network-changed-0325d548-3e13-4bf8-ab38-d939622e8d72. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] Acquiring lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] Acquired lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Refreshing network info cache for port 0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updated VIF entry in instance network info cache for port 0325d548-3e13-4bf8-ab38-d939622e8d72. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating instance_info_cache with network_info: [{"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd10290d-2e2c-442f-8dc6-8150aabb082e req-9769e2af-b43c-4793-bc90-6b397b46ae15 service nova] Releasing lock "refresh_cache-ee73e99a-6a19-4ea0-add9-54356a61f5b0" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:29 user nova-compute[75307]: INFO nova.compute.manager [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Terminating instance
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-unplugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] No waiting events found dispatching network-vif-unplugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-582a1f1a-8a14-4c35-9ad0-fd044ac0c74f req-d8b60574-4668-44cc-9d5c-7bf0047eadb7 service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-unplugged-0325d548-3e13-4bf8-ab38-d939622e8d72 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:25:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Instance destroyed successfully.
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.objects.instance [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid ee73e99a-6a19-4ea0-add9-54356a61f5b0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:23:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2066119474',display_name='tempest-TestVolumeBootPattern-server-2066119474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2066119474',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:23:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-29m4rvs5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:23:47Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=ee73e99a-6a19-4ea0-add9-54356a61f5b0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "0325d548-3e13-4bf8-ab38-d939622e8d72", "address": "fa:16:3e:c4:b7:f0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.17", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0325d548-3e", "ovs_interfaceid": "0325d548-3e13-4bf8-ab38-d939622e8d72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_vif [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0325d548-3e, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=63aacd66-f718-49b3-90d9-06dde04bdfe0) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:30 user nova-compute[75307]: INFO os_vif [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:b7:f0,bridge_name='br-int',has_traffic_filtering=True,id=0325d548-3e13-4bf8-ab38-d939622e8d72,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0325d548-3e')
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7468a2cd-2a2b-4e1b-8982-221a6ffebd3b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:25:30 user nova-compute[75307]: No targets found.
Nov 13 23:25:30 user nova-compute[75307]: iSNS:
Nov 13 23:25:30 user nova-compute[75307]: No targets found.
Nov 13 23:25:30 user nova-compute[75307]: STATIC:
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:25:30 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:30 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:30 user nova-compute[75307]: FIRMWARE:
Nov 13 23:25:30 user nova-compute[75307]: No targets found.
Nov 13 23:25:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:25:30 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:25:30 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff789157-4afb-46f3-a006-d9d040cefca2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ccffdf-2da0-4387-ac49-4ee28213f3b0]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:30 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb345a1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf204f5-aa97-4b58-a233-3934a383fcd5]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c9f487-b6ee-417c-a6db-d4f2e3996e6a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9963d10f-e3b2-4b63-bba6-68b0272d6832]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d0813-1b20-49bb-b75d-1a423f2a0b93]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed5c8d7-91db-4b56-987b-16fc1304e858]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b3765-7cd0-45f9-b377-e74d797b668d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]
Nov 13 23:25:30 user nova-compute[75307]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[053844ed-c77b-4baf-a0e8-80ef0dee5cfe]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (374ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:25:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Deleting instance files /opt/stack/data/nova/instances/ee73e99a-6a19-4ea0-add9-54356a61f5b0_del
Nov 13 23:25:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Deletion of /opt/stack/data/nova/instances/ee73e99a-6a19-4ea0-add9-54356a61f5b0_del complete
Nov 13 23:25:30 user nova-compute[75307]: INFO nova.compute.manager [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 13 23:25:30 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:25:30 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:25:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Snapshot image upload complete
Nov 13 23:25:31 user nova-compute[75307]: INFO nova.compute.manager [None req-a28e2654-a81f-417c-99aa-77aa28247b77 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Took 5.79 seconds to snapshot the instance on the hypervisor.
Nov 13 23:25:31 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:31 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Took 0.73 seconds to deallocate network for instance.
Nov 13 23:25:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-76831680-16ab-4438-8436-2c4de8f2a433 req-35e56ae1-25f1-41fd-b58e-34172144c12f service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-deleted-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:31 user nova-compute[75307]: INFO nova.compute.manager [req-76831680-16ab-4438-8436-2c4de8f2a433 req-35e56ae1-25f1-41fd-b58e-34172144c12f service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Neutron deleted interface 0325d548-3e13-4bf8-ab38-d939622e8d72; detaching it from the instance and deleting it from the info cache
Nov 13 23:25:31 user nova-compute[75307]: DEBUG nova.network.neutron [req-76831680-16ab-4438-8436-2c4de8f2a433 req-35e56ae1-25f1-41fd-b58e-34172144c12f service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-76831680-16ab-4438-8436-2c4de8f2a433 req-35e56ae1-25f1-41fd-b58e-34172144c12f service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Detach interface failed, port_id=0325d548-3e13-4bf8-ab38-d939622e8d72, reason: Instance ee73e99a-6a19-4ea0-add9-54356a61f5b0 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] Acquiring lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] No waiting events found dispatching network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:32 user nova-compute[75307]: WARNING nova.compute.manager [req-87104666-fc72-4d23-8834-120ee11ffe49 req-b141e55c-4333-4159-a9df-2fc513a054ac service nova] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Received unexpected event network-vif-plugged-0325d548-3e13-4bf8-ab38-d939622e8d72 for instance with vm_state active and task_state deleting.
Nov 13 23:25:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:32 user nova-compute[75307]: INFO nova.compute.manager [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: ee73e99a-6a19-4ea0-add9-54356a61f5b0] Took 1.22 seconds to detach 1 volumes for instance.
Nov 13 23:25:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.175s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:25:33 user nova-compute[75307]: INFO nova.compute.claims [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Claim successful on node user
Nov 13 23:25:33 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance ee73e99a-6a19-4ea0-add9-54356a61f5b0
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8c17096a-7845-4a0d-8757-9a98a830b242 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "ee73e99a-6a19-4ea0-add9-54356a61f5b0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.812s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:25:33 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.policy [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '519cf74c92b9446a9c644f45f3909253', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:25:33 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Creating image(s)
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "/opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "/opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "/opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:34 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Successfully created port: 55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.virt.images [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] 18da43ed-7578-42da-a308-de7e4ca53067 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.part /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.part /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.converted" returned: 0 in 0.302s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.585s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Successfully updated port: 55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquired lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing instance network info cache due to event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] Acquiring lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0,backing_fmt=raw /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0,backing_fmt=raw /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk 1073741824" returned: 0 in 0.047s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Releasing lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Instance network_info: |[{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] Acquired lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Ensure instance console log exists: /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Start _get_guest_xml network_info=[{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='ddd7b8a9288aa84277351033f24769a0',container_format='bare',created_at=2023-11-13T23:25:25Z,direct_url=<?>,disk_format='qcow2',id=18da43ed-7578-42da-a308-de7e4ca53067,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1958907000',owner='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T23:25:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '18da43ed-7578-42da-a308-de7e4ca53067'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:25:36 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:36 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='ddd7b8a9288aa84277351033f24769a0',container_format='bare',created_at=2023-11-13T23:25:25Z,direct_url=<?>,disk_format='qcow2',id=18da43ed-7578-42da-a308-de7e4ca53067,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1958907000',owner='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-13T23:25:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-934635618',display_name='tempest-TestStampPattern-server-934635618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934635618',id=29,image_ref='18da43ed-7578-42da-a308-de7e4ca53067',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-jv3zm364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f6233ac6-5054-48b9-94cf-607e2b2b28e9',image_min_disk='1',image_min_ram='0',image_owner_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',image_owner_project_name='tempest-TestStampPattern-1908061242',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1908061242-project-member',image_user_id='519cf74c92b9446a9c644f45f3909253',network_allocated='True',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:25:34Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=19e90d5b-1bf4-4f35-83ae-8738ee6f206a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.objects.instance [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'pci_devices' on Instance uuid 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:25:36 user nova-compute[75307]:   <uuid>19e90d5b-1bf4-4f35-83ae-8738ee6f206a</uuid>
Nov 13 23:25:36 user nova-compute[75307]:   <name>instance-0000001d</name>
Nov 13 23:25:36 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:25:36 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:25:36 user nova-compute[75307]:   <metadata>
Nov 13 23:25:36 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:25:36 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:name>tempest-TestStampPattern-server-934635618</nova:name>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:25:36</nova:creationTime>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:25:36 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:25:36 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:owner>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:user uuid="519cf74c92b9446a9c644f45f3909253">tempest-TestStampPattern-1908061242-project-member</nova:user>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:project uuid="3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb">tempest-TestStampPattern-1908061242</nova:project>
Nov 13 23:25:36 user nova-compute[75307]:       </nova:owner>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:root type="image" uuid="18da43ed-7578-42da-a308-de7e4ca53067"/>
Nov 13 23:25:36 user nova-compute[75307]:       <nova:ports>
Nov 13 23:25:36 user nova-compute[75307]:         <nova:port uuid="55db98cd-baed-4f71-9e0e-2b10eb3d0384">
Nov 13 23:25:36 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:25:36 user nova-compute[75307]:         </nova:port>
Nov 13 23:25:36 user nova-compute[75307]:       </nova:ports>
Nov 13 23:25:36 user nova-compute[75307]:     </nova:instance>
Nov 13 23:25:36 user nova-compute[75307]:   </metadata>
Nov 13 23:25:36 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:25:36 user nova-compute[75307]:     <system>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="serial">19e90d5b-1bf4-4f35-83ae-8738ee6f206a</entry>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="uuid">19e90d5b-1bf4-4f35-83ae-8738ee6f206a</entry>
Nov 13 23:25:36 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:25:36 user nova-compute[75307]:     </system>
Nov 13 23:25:36 user nova-compute[75307]:   </sysinfo>
Nov 13 23:25:36 user nova-compute[75307]:   <os>
Nov 13 23:25:36 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:25:36 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:25:36 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:25:36 user nova-compute[75307]:   </os>
Nov 13 23:25:36 user nova-compute[75307]:   <features>
Nov 13 23:25:36 user nova-compute[75307]:     <acpi/>
Nov 13 23:25:36 user nova-compute[75307]:     <apic/>
Nov 13 23:25:36 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:25:36 user nova-compute[75307]:   </features>
Nov 13 23:25:36 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:25:36 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:25:36 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:25:36 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:25:36 user nova-compute[75307]:   </clock>
Nov 13 23:25:36 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:25:36 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:25:36 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:25:36 user nova-compute[75307]:   </cpu>
Nov 13 23:25:36 user nova-compute[75307]:   <devices>
Nov 13 23:25:36 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:25:36 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:25:36 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk"/>
Nov 13 23:25:36 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:25:36 user nova-compute[75307]:     </disk>
Nov 13 23:25:36 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:25:36 user nova-compute[75307]:       <mac address="fa:16:3e:a2:c7:e4"/>
Nov 13 23:25:36 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:25:36 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:25:36 user nova-compute[75307]:       <target dev="tap55db98cd-ba"/>
Nov 13 23:25:36 user nova-compute[75307]:     </interface>
Nov 13 23:25:36 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:25:36 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/console.log" append="off"/>
Nov 13 23:25:36 user nova-compute[75307]:     </serial>
Nov 13 23:25:36 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:25:36 user nova-compute[75307]:     <video>
Nov 13 23:25:36 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:25:36 user nova-compute[75307]:     </video>
Nov 13 23:25:36 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:25:36 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:25:36 user nova-compute[75307]:     </rng>
Nov 13 23:25:36 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:25:36 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:25:36 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:25:36 user nova-compute[75307]:     </memballoon>
Nov 13 23:25:36 user nova-compute[75307]:   </devices>
Nov 13 23:25:36 user nova-compute[75307]: </domain>
Nov 13 23:25:36 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-934635618',display_name='tempest-TestStampPattern-server-934635618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934635618',id=29,image_ref='18da43ed-7578-42da-a308-de7e4ca53067',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-jv3zm364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f6233ac6-5054-48b9-94cf-607e2b2b28e9',image_min_disk='1',image_min_ram='0',image_owner_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',image_owner_project_name='tempest-TestStampPattern-1908061242',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1908061242-project-member',image_user_id='519cf74c92b9446a9c644f45f3909253',network_allocated='True',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:25:34Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=19e90d5b-1bf4-4f35-83ae-8738ee6f206a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG os_vif [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ac618b6b-081f-51ec-a136-9a1046ba3e2e', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap55db98cd-ba, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap55db98cd-ba, col_values=(('qos', UUID('28fd92b2-fbd3-4b8a-85f9-b0ab7e56c0b0')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap55db98cd-ba, col_values=(('external_ids', {'iface-id': '55db98cd-baed-4f71-9e0e-2b10eb3d0384', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:c7:e4', 'vm-uuid': '19e90d5b-1bf4-4f35-83ae-8738ee6f206a'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:36 user nova-compute[75307]: INFO os_vif [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba')
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No VIF found with MAC fa:16:3e:a2:c7:e4, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updated VIF entry in instance network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG nova.network.neutron [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:25:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-34cc07cb-1cd8-47b9-9adc-33701a5b675f req-a3dd0cda-cdee-4b23-a8e2-8cd63102d022 service nova] Releasing lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] No waiting events found dispatching network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:37 user nova-compute[75307]: WARNING nova.compute.manager [req-aff7e832-b262-4309-b930-e568b8d5b7c6 req-d17c061e-207e-40e0-97e0-d2f325bf6e15 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received unexpected event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 for instance with vm_state building and task_state spawning.
Nov 13 23:25:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:25:39 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Instance spawned successfully.
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:25:39 user nova-compute[75307]: INFO nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.compute.manager [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:39 user nova-compute[75307]: DEBUG nova.compute.manager [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] No waiting events found dispatching network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:25:39 user nova-compute[75307]: WARNING nova.compute.manager [req-adaae11e-7cd9-4bb2-b99e-7ae04253ab53 req-9e95b44d-5089-4ce7-888f-88cc730fb840 service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received unexpected event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 for instance with vm_state building and task_state spawning.
Nov 13 23:25:39 user nova-compute[75307]: INFO nova.compute.manager [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Took 6.69 seconds to build instance.
Nov 13 23:25:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-12908982-3d6c-474d-a2bb-0d6253e46385 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.794s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f309889-e21b-4311-a2c0-28b955011b38 is timed out.
Nov 13 23:25:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully detached device vdb from instance 5f309889-e21b-4311-a2c0-28b955011b38 from the live domain config.
Nov 13 23:25:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNQkqpIi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:25:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9662df-b99c-40cf-8f18-1f0904935461]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:25:48 user nova-compute[75307]: No targets found.
Nov 13 23:25:48 user nova-compute[75307]: iSNS:
Nov 13 23:25:48 user nova-compute[75307]: No targets found.
Nov 13 23:25:48 user nova-compute[75307]: STATIC:
Nov 13 23:25:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:25:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228
Nov 13 23:25:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:25:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:25:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:25:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:25:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:25:48 user nova-compute[75307]: FIRMWARE:
Nov 13 23:25:48 user nova-compute[75307]: No targets found.
Nov 13 23:25:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:25:48 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:25:48 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0970128a-2998-46b4-81ec-66d22e7b23bb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1dfb47-0a94-428b-a1d9-5ec9a955a626]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:25:48 user nova-compute[75307]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 (non-flash)
Nov 13 23:25:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c161510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc284bef-f320-478f-a53d-b16e4bf34805]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa64a3f0-f9b6-4af1-a729-3dc6c4c85644]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e435a6ba-1c59-445b-98ac-f6b542df45e0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7ea5cf-93a7-4700-8b14-b5418a95fc8b]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5032b4-de23-4537-a89c-792ed35ee852]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2139cde-3971-4ea6-911e-daa664fc5071]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260]
Nov 13 23:25:48 user nova-compute[75307]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228, portal: 172.16.0.220,3260] successful.
Nov 13 23:25:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86ed7175-086b-4f29-a50c-6870e375e228 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eddcaa-8393-48ab-85ea-af7f103b17b6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] <== disconnect_volume: return (295ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:25:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:25:49 user nova-compute[75307]: INFO nova.compute.manager [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Detaching volume a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:25:49 user nova-compute[75307]: INFO nova.virt.block_device [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Attempting to driver detach volume a071e26f-a3a6-486c-b643-7f1982c108ff from mountpoint /dev/vdb
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Attempting to detach device vdb from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:25:49 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:49 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:25:49 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:49 user nova-compute[75307]:   <serial>a071e26f-a3a6-486c-b643-7f1982c108ff</serial>
Nov 13 23:25:49 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:25:49 user nova-compute[75307]: </disk>
Nov 13 23:25:49 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:25:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully detached device vdb from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the persistent domain config.
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:25:49 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:25:49 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:25:49 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:25:49 user nova-compute[75307]:   <serial>a071e26f-a3a6-486c-b643-7f1982c108ff</serial>
Nov 13 23:25:49 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:25:49 user nova-compute[75307]: </disk>
Nov 13 23:25:49 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'flavor' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c2042c0a-0dc0-47d5-b630-f097e4babcde tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.841s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:25:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:25:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:25:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:09 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 is timed out.
Nov 13 23:26:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully detached device vdb from instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 from the live domain config.
Nov 13 23:26:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xKOigaoU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:09 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0315dd-1cf9-4e6a-aae0-eb40c49db351]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:26:09 user nova-compute[75307]: No targets found.
Nov 13 23:26:09 user nova-compute[75307]: iSNS:
Nov 13 23:26:09 user nova-compute[75307]: No targets found.
Nov 13 23:26:09 user nova-compute[75307]: STATIC:
Nov 13 23:26:09 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:26:09 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:26:09 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:26:09 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:26:09 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:26:09 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:26:09 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:26:09 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:26:09 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:26:09 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff
Nov 13 23:26:09 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:26:09 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:26:09 user nova-compute[75307]: FIRMWARE:
Nov 13 23:26:09 user nova-compute[75307]: No targets found.
Nov 13 23:26:09 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:26:09 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:26:09 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ea3e0c-94b9-47f8-8f95-226a8ebe047d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9494804a-9d72-4284-9a44-1be624f35b23]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:09 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:09 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:09 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c0d09d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff'): ({'sdg'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Removing single pathed devices sdg {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d1cebf-40e4-4ec4-ae36-0f123e363cd8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfb36e0-e276-4486-b9df-be0289f39193]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Flushing IO for device /dev/sdg {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d17a019-775a-4559-87b0-42df3912e186]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:26:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2d066d-4181-438c-99ca-b2a25bc34b04]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad31b1fe-7402-4166-9898-bfd0d5c309fc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6528c5-5e77-4f78-a92d-b1ca4e7146db]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260]
Nov 13 23:26:10 user nova-compute[75307]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff, portal: 172.16.0.220,3260] successful.
Nov 13 23:26:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a071e26f-a3a6-486c-b643-7f1982c108ff -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef419ed-6928-4d6b-9709-f58094606241]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] <== disconnect_volume: return (314ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'flavor' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-203cad4b-9c64-49c3-a96c-79da356b2642 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.777s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:26:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:15 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7284MB free_disk=25.119422912597656GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Applying migration context for instance a90dad03-c454-4728-a5a6-cf5759a41ed7 as it has an incoming, in-progress migration ee86dc33-f210-41e7-bebf-82d23b329579. Migration status is finished {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 23:26:15 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating resource usage from migration ee86dc33-f210-41e7-bebf-82d23b329579
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5f309889-e21b-4311-a2c0-28b955011b38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d27f63dd-33ee-418f-90bc-297622ae340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Migration ee86dc33-f210-41e7-bebf-82d23b329579 is active on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:26:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:26:16 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:26:16 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:26:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:26:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating instance_info_cache with network_info: [{"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-5f309889-e21b-4311-a2c0-28b955011b38" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:26:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:26:21 user nova-compute[75307]: INFO nova.compute.claims [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Claim successful on node user
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:26:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.policy [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:26:22 user nova-compute[75307]: INFO nova.virt.block_device [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Booting with volume 799fe3d4-f050-4fc8-8bee-2b3b0b188c70 at /dev/vda
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.utils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[49aaa2e2-db5d-44d6-9788-4d4ce603f02f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1676563e-107c-4d66-b2b2-efa5d9cff1ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[50beae3a-f106-459b-a18e-74cc931d9dd8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b29e3d7b-f44a-4e3b-914b-142e23171bb5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:22 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:26:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f41d524-a0c7-437e-ba70-a8f9082ca538]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG os_brick.utils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:22 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating existing volume attachment record: 6654c83a-b336-4353-b8c4-f407108b7c19 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:26:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Successfully created port: eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:26:24 user nova-compute[75307]: INFO nova.compute.manager [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Unrescuing
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Successfully updated port: eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing instance network info cache due to event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] Acquiring lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'flavor' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Instance network_info: |[{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] Acquired lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:25 user nova-compute[75307]: WARNING nova.compute.manager [req-d119ef6d-83e7-4cf0-93b2-8407d3cc1a5a req-5b68ec24-37f2-43fa-8b70-dfad35c18ce4 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:26:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance destroyed successfully.
Nov 13 23:26:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updated VIF entry in instance network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ec89142b-4db9-40d8-a548-a30995020c5e req-ad0532b1-1502-4ec9-b538-b03efb62c47a service nova] Releasing lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:26:27 user nova-compute[75307]: INFO nova.compute.claims [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Claim successful on node user
Nov 13 23:26:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING nova.compute.manager [req-e93982e8-0f49-4322-aa61-bc0a1b499faf req-c6b048c7-8564-47a2-8ebf-8921467c651d service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:26:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Creating image(s)
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Ensure instance console log exists: /opt/stack/data/nova/instances/25c8b300-4c7b-4370-b014-41b0085dc217/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Start _get_guest_xml network_info=[{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '25c8b300-4c7b-4370-b014-41b0085dc217', 'attached_at': '', 'detached_at': '', 'volume_id': '799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'serial': '799fe3d4-f050-4fc8-8bee-2b3b0b188c70'}, 'delete_on_termination': False, 'attachment_id': '6654c83a-b336-4353-b8c4-f407108b7c19', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:27 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4fe6d1-54ee-4302-bb04-63d5b4bf1cc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:26:27 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[50103c6e-77cf-4d11-91bd-f301eb96cc0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70] added
Nov 13 23:26:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc6490f-2380-40d1-b561-4653dd45f81a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd589e59-a09e-410c-afc1-b2ab3f6d5e70]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtiVsSL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xHtiVsSL" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34b79c-5537-4ee6-9d9b-65449d3072db]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xHtiVsSL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f206e1-5969-4d08-923e-4ced98886275]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94f5cf7-c88b-48bf-a599-16bcc82a8633]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.policy [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f09950b58c343f8b8684ab68aeb6f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd367a26c5f3e408caeb0ffa8311f3d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5f31f-96a5-40ea-ac5b-2eb297f60239]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]
Nov 13 23:26:28 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.
Nov 13 23:26:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fd8bfa-21a5-4b0a-ad24-433707efb0a7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38abcd2-2b35-47d7-a5b3-75c65d45ff90]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:28 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:26:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Creating image(s)
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "/opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "/opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "/opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[586b8aa0-37d4-437a-95c7-c3ff118a2faa]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.214s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "5f309889-e21b-4311-a2c0-28b955011b38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:28 user nova-compute[75307]: INFO nova.compute.manager [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Terminating instance
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk 1073741824" returned: 0 in 0.065s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Successfully created port: a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Cannot resize image /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Ensure instance console log exists: /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fa282dd8-2f77-4ca3-a608-f8bc7c6644c5 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26435303433633237', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435303433633237', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204055908',display_name='tempest-TestVolumeBootPattern-server-204055908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204055908',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-zd9j8azt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:26:23Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=25c8b300-4c7b-4370-b014-41b0085dc217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid 25c8b300-4c7b-4370-b014-41b0085dc217 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:26:29 user nova-compute[75307]:   <uuid>25c8b300-4c7b-4370-b014-41b0085dc217</uuid>
Nov 13 23:26:29 user nova-compute[75307]:   <name>instance-0000001e</name>
Nov 13 23:26:29 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:26:29 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:26:29 user nova-compute[75307]:   <metadata>
Nov 13 23:26:29 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:26:29 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:26:29 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-server-204055908</nova:name>
Nov 13 23:26:29 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:26:27</nova:creationTime>
Nov 13 23:26:29 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:26:29 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:26:29 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:26:29 user nova-compute[75307]:       <nova:owner>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:26:29 user nova-compute[75307]:       </nova:owner>
Nov 13 23:26:29 user nova-compute[75307]:       <nova:ports>
Nov 13 23:26:29 user nova-compute[75307]:         <nova:port uuid="eafe0117-bd9d-49e4-8866-7d470c0a0ed3">
Nov 13 23:26:29 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 23:26:29 user nova-compute[75307]:         </nova:port>
Nov 13 23:26:29 user nova-compute[75307]:       </nova:ports>
Nov 13 23:26:29 user nova-compute[75307]:     </nova:instance>
Nov 13 23:26:29 user nova-compute[75307]:   </metadata>
Nov 13 23:26:29 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:26:29 user nova-compute[75307]:     <system>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="serial">25c8b300-4c7b-4370-b014-41b0085dc217</entry>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="uuid">25c8b300-4c7b-4370-b014-41b0085dc217</entry>
Nov 13 23:26:29 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:26:29 user nova-compute[75307]:     </system>
Nov 13 23:26:29 user nova-compute[75307]:   </sysinfo>
Nov 13 23:26:29 user nova-compute[75307]:   <os>
Nov 13 23:26:29 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:26:29 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:26:29 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:26:29 user nova-compute[75307]:   </os>
Nov 13 23:26:29 user nova-compute[75307]:   <features>
Nov 13 23:26:29 user nova-compute[75307]:     <acpi/>
Nov 13 23:26:29 user nova-compute[75307]:     <apic/>
Nov 13 23:26:29 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:26:29 user nova-compute[75307]:   </features>
Nov 13 23:26:29 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:26:29 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:26:29 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:26:29 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:26:29 user nova-compute[75307]:   </clock>
Nov 13 23:26:29 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:26:29 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:26:29 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:26:29 user nova-compute[75307]:   </cpu>
Nov 13 23:26:29 user nova-compute[75307]:   <devices>
Nov 13 23:26:29 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:26:29 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:26:29 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:26:29 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:26:29 user nova-compute[75307]:       <serial>799fe3d4-f050-4fc8-8bee-2b3b0b188c70</serial>
Nov 13 23:26:29 user nova-compute[75307]:     </disk>
Nov 13 23:26:29 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:26:29 user nova-compute[75307]:       <mac address="fa:16:3e:c4:38:69"/>
Nov 13 23:26:29 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:26:29 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:26:29 user nova-compute[75307]:       <target dev="tapeafe0117-bd"/>
Nov 13 23:26:29 user nova-compute[75307]:     </interface>
Nov 13 23:26:29 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:26:29 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/25c8b300-4c7b-4370-b014-41b0085dc217/console.log" append="off"/>
Nov 13 23:26:29 user nova-compute[75307]:     </serial>
Nov 13 23:26:29 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:26:29 user nova-compute[75307]:     <video>
Nov 13 23:26:29 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:26:29 user nova-compute[75307]:     </video>
Nov 13 23:26:29 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:26:29 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:26:29 user nova-compute[75307]:     </rng>
Nov 13 23:26:29 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:26:29 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:26:29 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:26:29 user nova-compute[75307]:     </memballoon>
Nov 13 23:26:29 user nova-compute[75307]:   </devices>
Nov 13 23:26:29 user nova-compute[75307]: </domain>
Nov 13 23:26:29 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204055908',display_name='tempest-TestVolumeBootPattern-server-204055908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204055908',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-zd9j8azt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:26:23Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=25c8b300-4c7b-4370-b014-41b0085dc217,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG os_vif [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d61ab43-646a-5bc6-920c-6c20b7c55ff2', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeafe0117-bd, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeafe0117-bd, col_values=(('qos', UUID('106987e7-a233-46d3-9ede-ecfcab97ae0c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeafe0117-bd, col_values=(('external_ids', {'iface-id': 'eafe0117-bd9d-49e4-8866-7d470c0a0ed3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c4:38:69', 'vm-uuid': '25c8b300-4c7b-4370-b014-41b0085dc217'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: INFO os_vif [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd')
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Successfully updated port: a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquired lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:c4:38:69, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:26:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Instance destroyed successfully.
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lazy-loading 'resources' on Instance uuid 5f309889-e21b-4311-a2c0-28b955011b38 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:20:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-48710663',display_name='tempest-SnapshotDataIntegrityTests-server-48710663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-48710663',id=21,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOR2zWZyqc6QrrfNiub+NcJlSIuulmT/MWMPubLdVWgJDac3dkNuVVB8i29ES9hFYrOcwbcSrUtxMWLol2SYY1ZiHvhcGuHwzg7UiyUbQFyjRYUtvesKCiUL3lRHnB1qQ==',key_name='tempest-keypair-737270727',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:20:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c26ffef772d4f5bb79d88595d519ebc',ramdisk_id='',reservation_id='r-ffup8n3s',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1226104925',owner_user_name='tempest-SnapshotDataIntegrityTests-1226104925-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1dadb69ade9241539a1d0747d728d403',uuid=5f309889-e21b-4311-a2c0-28b955011b38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converting VIF {"id": "2d5bcd47-a6e8-455c-8136-245972dbac84", "address": "fa:16:3e:80:4b:90", "network": {"id": "d364de15-ffd3-494a-8f6a-b31d97898841", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1384789154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.235", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c26ffef772d4f5bb79d88595d519ebc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d5bcd47-a6", "ovs_interfaceid": "2d5bcd47-a6e8-455c-8136-245972dbac84", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG os_vif [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d5bcd47-a6, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4dabf9e3-964f-4cd5-b151-e26e63ad0c2f) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:26:29 user nova-compute[75307]: INFO os_vif [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:80:4b:90,bridge_name='br-int',has_traffic_filtering=True,id=2d5bcd47-a6e8-455c-8136-245972dbac84,network=Network(d364de15-ffd3-494a-8f6a-b31d97898841),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d5bcd47-a6')
Nov 13 23:26:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Deleting instance files /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38_del
Nov 13 23:26:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Deletion of /opt/stack/data/nova/instances/5f309889-e21b-4311-a2c0-28b955011b38_del complete
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-changed-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Refreshing instance network info cache due to event network-changed-a2bd0ac5-e59e-477f-8d92-0f225b54b799. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] Acquiring lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:29 user nova-compute[75307]: INFO nova.compute.manager [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updating instance_info_cache with network_info: [{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Releasing lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Instance network_info: |[{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] Acquired lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Refreshing network info cache for port a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Start _get_guest_xml network_info=[{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:26:29 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:29 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:26:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1695355740',display_name='tempest-ServersNegativeTestJSON-server-1695355740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1695355740',id=31,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-t7bvsq2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:26:28Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=81ca5221-bb7d-4587-999b-c772bfe99128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lazy-loading 'pci_devices' on Instance uuid 81ca5221-bb7d-4587-999b-c772bfe99128 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:26:30 user nova-compute[75307]:   <uuid>81ca5221-bb7d-4587-999b-c772bfe99128</uuid>
Nov 13 23:26:30 user nova-compute[75307]:   <name>instance-0000001f</name>
Nov 13 23:26:30 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:26:30 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:26:30 user nova-compute[75307]:   <metadata>
Nov 13 23:26:30 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:26:30 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:name>tempest-ServersNegativeTestJSON-server-1695355740</nova:name>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:26:29</nova:creationTime>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:26:30 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:26:30 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:owner>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:user uuid="9f09950b58c343f8b8684ab68aeb6f97">tempest-ServersNegativeTestJSON-1320604312-project-member</nova:user>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:project uuid="d367a26c5f3e408caeb0ffa8311f3d14">tempest-ServersNegativeTestJSON-1320604312</nova:project>
Nov 13 23:26:30 user nova-compute[75307]:       </nova:owner>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:26:30 user nova-compute[75307]:       <nova:ports>
Nov 13 23:26:30 user nova-compute[75307]:         <nova:port uuid="a2bd0ac5-e59e-477f-8d92-0f225b54b799">
Nov 13 23:26:30 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:26:30 user nova-compute[75307]:         </nova:port>
Nov 13 23:26:30 user nova-compute[75307]:       </nova:ports>
Nov 13 23:26:30 user nova-compute[75307]:     </nova:instance>
Nov 13 23:26:30 user nova-compute[75307]:   </metadata>
Nov 13 23:26:30 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:26:30 user nova-compute[75307]:     <system>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="serial">81ca5221-bb7d-4587-999b-c772bfe99128</entry>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="uuid">81ca5221-bb7d-4587-999b-c772bfe99128</entry>
Nov 13 23:26:30 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:26:30 user nova-compute[75307]:     </system>
Nov 13 23:26:30 user nova-compute[75307]:   </sysinfo>
Nov 13 23:26:30 user nova-compute[75307]:   <os>
Nov 13 23:26:30 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:26:30 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:26:30 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:26:30 user nova-compute[75307]:   </os>
Nov 13 23:26:30 user nova-compute[75307]:   <features>
Nov 13 23:26:30 user nova-compute[75307]:     <acpi/>
Nov 13 23:26:30 user nova-compute[75307]:     <apic/>
Nov 13 23:26:30 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:26:30 user nova-compute[75307]:   </features>
Nov 13 23:26:30 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:26:30 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:26:30 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:26:30 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:26:30 user nova-compute[75307]:   </clock>
Nov 13 23:26:30 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:26:30 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:26:30 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:26:30 user nova-compute[75307]:   </cpu>
Nov 13 23:26:30 user nova-compute[75307]:   <devices>
Nov 13 23:26:30 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:26:30 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:26:30 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk"/>
Nov 13 23:26:30 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:26:30 user nova-compute[75307]:     </disk>
Nov 13 23:26:30 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:26:30 user nova-compute[75307]:       <mac address="fa:16:3e:48:6d:3c"/>
Nov 13 23:26:30 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:26:30 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:26:30 user nova-compute[75307]:       <target dev="tapa2bd0ac5-e5"/>
Nov 13 23:26:30 user nova-compute[75307]:     </interface>
Nov 13 23:26:30 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:26:30 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/console.log" append="off"/>
Nov 13 23:26:30 user nova-compute[75307]:     </serial>
Nov 13 23:26:30 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:26:30 user nova-compute[75307]:     <video>
Nov 13 23:26:30 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:26:30 user nova-compute[75307]:     </video>
Nov 13 23:26:30 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:26:30 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:26:30 user nova-compute[75307]:     </rng>
Nov 13 23:26:30 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:26:30 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:26:30 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:26:30 user nova-compute[75307]:     </memballoon>
Nov 13 23:26:30 user nova-compute[75307]:   </devices>
Nov 13 23:26:30 user nova-compute[75307]: </domain>
Nov 13 23:26:30 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1695355740',display_name='tempest-ServersNegativeTestJSON-server-1695355740',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1695355740',id=31,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-t7bvsq2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:26:28Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=81ca5221-bb7d-4587-999b-c772bfe99128,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG os_vif [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c43783a8-c733-56da-98cb-9f7a946084fa', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa2bd0ac5-e5, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa2bd0ac5-e5, col_values=(('qos', UUID('c125a9e6-60c6-4836-b6ba-fa2bc6211ede')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa2bd0ac5-e5, col_values=(('external_ids', {'iface-id': 'a2bd0ac5-e59e-477f-8d92-0f225b54b799', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:6d:3c', 'vm-uuid': '81ca5221-bb7d-4587-999b-c772bfe99128'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:30 user nova-compute[75307]: INFO os_vif [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5')
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] No VIF found with MAC fa:16:3e:48:6d:3c, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.neutron [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updated VIF entry in instance network info cache for port a2bd0ac5-e59e-477f-8d92-0f225b54b799. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.neutron [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updating instance_info_cache with network_info: [{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f82e818e-7d98-4a3e-9470-67695b3f3bb6 req-477121f3-1f11-4e7a-b97b-ee82e63d820a service nova] Releasing lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:30 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Took 0.91 seconds to deallocate network for instance.
Nov 13 23:26:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-c2916908-65b4-480a-8ff8-37c460fe4ac6 req-092d3cc0-a2c4-4afe-8a4c-e3beff1047db service nova] [instance: 5f309889-e21b-4311-a2c0-28b955011b38] Received event network-vif-deleted-2d5bcd47-a6e8-455c-8136-245972dbac84 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:31 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Deleted allocations for instance 5f309889-e21b-4311-a2c0-28b955011b38
Nov 13 23:26:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0efb2e50-9cf8-4b5a-8ff8-71ec930c79d9 tempest-SnapshotDataIntegrityTests-1226104925 tempest-SnapshotDataIntegrityTests-1226104925-project-member] Lock "5f309889-e21b-4311-a2c0-28b955011b38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] No waiting events found dispatching network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:32 user nova-compute[75307]: WARNING nova.compute.manager [req-b3177164-0129-429b-a97a-6146354e90dc req-b5b9ca03-e5d5-4029-a67f-38896f857f7c service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received unexpected event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 for instance with vm_state building and task_state spawning.
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] No waiting events found dispatching network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:32 user nova-compute[75307]: WARNING nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received unexpected event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 for instance with vm_state building and task_state spawning.
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] No waiting events found dispatching network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:32 user nova-compute[75307]: WARNING nova.compute.manager [req-70e712fe-7134-4ad1-985a-4193a32d393b req-9d47c281-ee72-4a0c-8836-b7d30ed5e2fd service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received unexpected event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 for instance with vm_state building and task_state spawning.
Nov 13 23:26:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] No waiting events found dispatching network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:34 user nova-compute[75307]: WARNING nova.compute.manager [req-a56ff58a-c9dd-4dfe-bd23-8b1257999e8c req-18e46ef5-5178-4fec-827e-bc0700f40d95 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received unexpected event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 for instance with vm_state building and task_state spawning.
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Instance spawned successfully.
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Instance spawned successfully.
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.compute.manager [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Took 7.61 seconds to build instance.
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Took 7.07 seconds to spawn the instance on the hypervisor.
Nov 13 23:26:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:26:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c9a65e38-4bd4-40e6-a91c-5063b90864bc tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.723s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:34 user nova-compute[75307]: INFO nova.compute.manager [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Took 13.12 seconds to build instance.
Nov 13 23:26:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7db84601-106d-4ce9-9044-9c9b981df392 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.269s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:39 user nova-compute[75307]: INFO nova.compute.manager [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Terminating instance
Nov 13 23:26:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-unplugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] No waiting events found dispatching network-vif-unplugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9b799f-e9c8-4684-b17d-11a85cf2fbf0 req-11017e21-8784-4bb2-b133-337f6a1dcd8e service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-unplugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Instance destroyed successfully.
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lazy-loading 'resources' on Instance uuid 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1394172118',display_name='tempest-TestServerVolumeAttachmentScenario-server-1394172118',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1394172118',id=26,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlPTkUT40JFzXCc0sfrNbaYvHa68yPQx20BljzA6fQPGc6YYCLocWfviIPBeaq+lcwFJwtQFI5Oe+oqnFQ1JmNqduZLtyPBUS7oMdoXusHjIpVu4KWn6Dl6F+UFmqeZmw==',key_name='tempest-keypair-1406349027',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7dc71aa0370b4722b50f94e861e3be5b',ramdisk_id='',reservation_id='r-9svlvp4c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-322297181',owner_user_name='tempest-TestServerVolumeAttachmentScenario-322297181-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:22:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='30ed4e378e8344ab96e8fa91607b7bf9',uuid=5cbefdf9-0ed8-4c05-906e-c77d1bfdc476,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converting VIF {"id": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "address": "fa:16:3e:7c:05:80", "network": {"id": "e1d7436d-ab17-40c6-9c41-b2e7d2d967af", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-57875746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7dc71aa0370b4722b50f94e861e3be5b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbcaf40a9-c2", "ovs_interfaceid": "bcaf40a9-c22b-46fb-991b-52f3ed4794fb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG os_vif [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbcaf40a9-c2, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90f56a09-a23b-40eb-9f3b-969bfc8e5799) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:26:40 user nova-compute[75307]: INFO os_vif [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:05:80,bridge_name='br-int',has_traffic_filtering=True,id=bcaf40a9-c22b-46fb-991b-52f3ed4794fb,network=Network(e1d7436d-ab17-40c6-9c41-b2e7d2d967af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbcaf40a9-c2')
Nov 13 23:26:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Deleting instance files /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476_del
Nov 13 23:26:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Deletion of /opt/stack/data/nova/instances/5cbefdf9-0ed8-4c05-906e-c77d1bfdc476_del complete
Nov 13 23:26:40 user nova-compute[75307]: INFO nova.compute.manager [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 23:26:40 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:26:40 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:41 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Took 0.92 seconds to deallocate network for instance.
Nov 13 23:26:41 user nova-compute[75307]: DEBUG nova.compute.manager [req-10f321a5-1e3c-4685-9284-48bdabc3523e req-02c03579-32da-4ed4-84c2-205df4660aa3 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-deleted-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:26:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:42 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Deleted allocations for instance 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476
Nov 13 23:26:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-29fab7cf-3071-4656-bf82-ab7565e40450 tempest-TestServerVolumeAttachmentScenario-322297181 tempest-TestServerVolumeAttachmentScenario-322297181-project-member] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.391s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] Acquiring lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] Lock "5cbefdf9-0ed8-4c05-906e-c77d1bfdc476-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] No waiting events found dispatching network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:26:42 user nova-compute[75307]: WARNING nova.compute.manager [req-8a395ee3-fa33-4899-ace2-8c9bbb9c9d4d req-3fa630db-6163-40f2-ba23-452bd2d6c6a0 service nova] [instance: 5cbefdf9-0ed8-4c05-906e-c77d1bfdc476] Received unexpected event network-vif-plugged-bcaf40a9-c22b-46fb-991b-52f3ed4794fb for instance with vm_state deleted and task_state None.
Nov 13 23:26:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-changed-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:26:43 user nova-compute[75307]: DEBUG nova.compute.manager [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Refreshing instance network info cache due to event network-changed-295a9e27-b825-484b-bfd9-a947cb2e8a13. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:26:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] Acquiring lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] Acquired lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:43 user nova-compute[75307]: DEBUG nova.network.neutron [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Refreshing network info cache for port 295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:26:44 user nova-compute[75307]: DEBUG nova.network.neutron [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updated VIF entry in instance network info cache for port 295a9e27-b825-484b-bfd9-a947cb2e8a13. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:26:44 user nova-compute[75307]: DEBUG nova.network.neutron [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating instance_info_cache with network_info: [{"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38ec7d7f-22c7-460b-b2da-e4d9c8e8efde req-abd57222-6c25-4ecc-8d09-86727056d4a5 service nova] Releasing lock "refresh_cache-d27f63dd-33ee-418f-90bc-297622ae340b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:45 user nova-compute[75307]: INFO nova.compute.manager [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attaching volume d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea to /dev/vdb
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.utils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4a7b39-72ef-4a78-ae5d-1fdf7bce9835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[574f3134-a5d8-4a43-b6ff-5e6c305bc555]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07fe3f2-17a8-4de1-b2d7-a05e38d1e7e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[06071491-3f74-4442-9598-40671214d0f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:45 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:26:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[abfa3e0c-843f-448f-9259-8c4c17e45f18]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG os_brick.utils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:45 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating existing volume attachment record: 59f4a2a8-f3bb-4696-b60e-f8732018643a {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:26:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuWqUIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:49 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:49 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:49 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a308c32-07d9-4e12-ab19-fb63e789b086]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:26:49 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cedb59c2-495a-4e50-9ed9-72f88093ca94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea] added
Nov 13 23:26:49 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e2e1b0-d189-4b89-98e2-f161a42458e2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30061b4-dd85-465e-a761-d32738b045e2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsuWqUIy {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsuWqUIy" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8d9621-fc91-4c8a-82c2-cba1c0a8345c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HsuWqUIy'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c857f7e-7f57-4578-99c6-58fa7b089776]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f7a64f-6fc9-40cd-947a-cc8a118277ff]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f818afd-2132-4c4a-af7b-9532db35fe41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260]
Nov 13 23:26:50 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:26:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f93a701-b27b-414d-b67a-ce1cce68c9de]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd316467-6f76-44a5-afa2-3f9aa45d5065]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:50 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] HCTL ('36', '-', '-', 0) found on session 40 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f876b2ed-ca77-4841-944e-6df736fba702]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:26:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 40 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuWqUIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23066343038663963', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066343038663963', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:26:51 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:26:51 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:26:51 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:26:51 user nova-compute[75307]:   <serial>d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea</serial>
Nov 13 23:26:51 user nova-compute[75307]: </disk>
Nov 13 23:26:51 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No VIF found with MAC fa:16:3e:41:37:9d, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:26:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7d3bd570-cd89-46d3-a948-b095d37b1f05 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.109s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:26:54 user nova-compute[75307]: INFO nova.compute.manager [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attaching volume 32bf12cf-038d-4df5-b811-c91f87502fe3 to /dev/vdc
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.utils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c678941-950a-4904-a3c6-f7d59ee19e8c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b599f9-e676-4022-b23f-2eaa6a4c3315]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c79f80b-d5d9-4013-971d-2725022cfa14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c15a42-0e31-44f0-9139-6ffde58eb7f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:26:54 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:26:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24ed58e-35af-4194-adc6-57a858394db3]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG os_brick.utils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:54 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating existing volume attachment record: 358e25aa-9606-45a1-bb65-8094ff963c3b {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:26:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYLiDoMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:26:58 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:58 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:26:58 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43dbb84-aaea-44a5-b716-3ea5aac791d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:26:58 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a7e787-6b27-4746-8e23-450a8be8d52c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3] added
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[981dfe3e-414c-404e-b584-401a2c3831f2]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a15019e-4574-459b-a658-ae2b535e3569]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYLiDoMu {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eYLiDoMu" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[228aa77f-8e67-4007-ae11-3b16d23a1650]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eYLiDoMu'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c59c2-be3a-4057-a792-a27c87f7832e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[44933fe7-6cce-4a3b-98b2-8ff50fac59a5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73288b2f-2446-43f8-b181-e194a6b98b35]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260]
Nov 13 23:26:58 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260] successful.
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d70f0-cac6-4658-9c54-4845cd1207c5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b8b1f6-a05e-497e-b7f3-e082ad10b5f5]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:26:58 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:26:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] HCTL ('38', '-', '-', 0) found on session 41 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0ffd2-0b31-42a2-be29-c7ba053f3b5e]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Searching for a device in session 41 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:26:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYLiDoMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Port 47e669d9-2897-4d52-8611-36afbf74c293 binding to destination host user is already ACTIVE {{(pid=75307) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Creating tmpfile /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/tmpb12_usoa to verify with other compute node that the instance is on the same shared storage. {{(pid=75307) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23862386130393834', 'path': '/dev/sdg'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:26:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862386130393834', 'path': '/dev/sdg'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:27:00 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:00 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:27:00 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:27:00 user nova-compute[75307]:   <serial>32bf12cf-038d-4df5-b811-c91f87502fe3</serial>
Nov 13 23:27:00 user nova-compute[75307]: </disk>
Nov 13 23:27:00 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:00 user nova-compute[75307]: WARNING nova.compute.manager [req-2c24cb18-f19c-4a0a-b0b7-14d4fb4fc8c1 req-e954afd6-3836-4ba8-a83b-9011da95c360 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state resized and task_state resize_reverting.
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] No VIF found with MAC fa:16:3e:41:37:9d, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0ede2b5-26e2-4416-abf0-b7b324110e7a tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.218s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance destroyed successfully.
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'resources' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:25:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e669d9-28, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c6ff039c-c426-4029-9736-5035cc6e2efe) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:00 user nova-compute[75307]: INFO os_vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:27:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547a93f-d88d-4979-9d18-aa066904f0c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:27:00 user nova-compute[75307]: No targets found.
Nov 13 23:27:00 user nova-compute[75307]: iSNS:
Nov 13 23:27:00 user nova-compute[75307]: No targets found.
Nov 13 23:27:00 user nova-compute[75307]: STATIC:
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:27:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:00 user nova-compute[75307]: FIRMWARE:
Nov 13 23:27:00 user nova-compute[75307]: No targets found.
Nov 13 23:27:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:27:00 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:27:00 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8daf40ec-b6c3-4d31-abc1-7b5e8f29c69c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[250c5dd1-df8f-45ba-8675-1b13499445b3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:00 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb45a38820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2336e8b1-848a-4e44-8751-4a142a999074]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e1dced-37d0-4241-b3be-6de3a1f0bbcd]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb0e83c-3411-48c1-9278-26ab80dccb99]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e245763-1aef-4cbb-9bc7-23190eff5b2f]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[367f7899-929f-4cea-b695-eed98d3aebca]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7abe07a-57a1-43b4-963b-d790d6dd1433]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:27:01 user nova-compute[75307]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:01 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[875d569b-dea0-4697-831c-2da8acb7d1b3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== disconnect_volume: return (327ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:01 user nova-compute[75307]: INFO nova.compute.manager [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Detaching volume d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea
Nov 13 23:27:01 user nova-compute[75307]: INFO nova.virt.block_device [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attempting to driver detach volume d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea from mountpoint /dev/vdb
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Attempting to detach device vdb from instance d27f63dd-33ee-418f-90bc-297622ae340b from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:01 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:01 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:27:01 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:01 user nova-compute[75307]:   <serial>d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea</serial>
Nov 13 23:27:01 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:27:01 user nova-compute[75307]: </disk>
Nov 13 23:27:01 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdb from instance d27f63dd-33ee-418f-90bc-297622ae340b from the persistent domain config.
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d27f63dd-33ee-418f-90bc-297622ae340b from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:01 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:01 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:27:01 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:01 user nova-compute[75307]:   <serial>d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea</serial>
Nov 13 23:27:01 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:27:01 user nova-compute[75307]: </disk>
Nov 13 23:27:01 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'migration_context' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.objects.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Object Instance<a90dad03-c454-4728-a5a6-cf5759a41ed7> lazy-loaded attributes: resources,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:02 user nova-compute[75307]: WARNING nova.compute.manager [req-e0f3852b-fa7f-4d01-93fa-47d309a01fc2 req-58871bc2-318e-4c31-a7fd-88202a7747fc service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state resized and task_state resize_reverting.
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.431s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:02 user nova-compute[75307]: INFO nova.compute.manager [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Swapping old allocation on dict_keys(['29c847ea-f19e-4e70-a7de-654601b2bd95']) held by migration ee86dc33-f210-41e7-bebf-82d23b329579 for instance
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Overwriting current allocation {'allocations': {'29c847ea-f19e-4e70-a7de-654601b2bd95': {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}, 'generation': 35}}, 'project_id': '9031887798954fab9ea96c7ce9c30984', 'user_id': '025c402ce1bc4de7a718a2b5e119b4ae', 'consumer_generation': 1} on consumer a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquired lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:27:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Releasing lock "refresh_cache-a90dad03-c454-4728-a5a6-cf5759a41ed7" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f86e1a-efc8-4fa0-b877-72547b1a883e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1ea6cd-2c7d-479c-8d52-a34222efc063]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e2a4d59-fd24-4836-a499-d618fbef994e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6111c13c-0bd3-4d18-a36b-b8581852f9bf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:27:03 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a0a2e9-8107-4c22-8b2b-a9c536dc6758]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Starting finish_revert_migration {{(pid=75307) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start _get_guest_xml network_info=[{"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a90dad03-c454-4728-a5a6-cf5759a41ed7', 'attached_at': '2023-11-13T23:27:07.000000', 'detached_at': '', 'volume_id': '634bc8fe-fec1-430f-8083-7721767f4bea', 'serial': '634bc8fe-fec1-430f-8083-7721767f4bea'}, 'delete_on_termination': False, 'attachment_id': 'c09add47-09e7-4761-a6f4-79fa48b5ace7', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:27:07 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:27:07 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:27:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'vcpu_model' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:07 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e0e53eb-025f-4043-9331-5ad8e75e1c2d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:27:07 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21cba4a-6e37-41ea-82ab-aee7aaa50982]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea] added
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2224da4-7ffe-4770-b06f-79f48477853e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd0241d-6b63-4e12-a481-3267138d1808]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrhcmVOL" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cbd0a0-6647-43dd-a7db-0b8b6c3f8293]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrhcmVOL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c378ec-d8aa-4a98-933a-0b9d322d70a9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1990d1-0a3f-4b18-9330-348447db9239]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef9222-2480-4da4-8ceb-b627b60c32d3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:27:07 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[45abe6f9-fa42-401d-a0cf-13e6f0b666c4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.087s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[047dd9b9-35f7-4cee-8ba4-9a1986dabec3]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:07 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.377s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef6b55a-f4a5-4b80-925f-25322162a1f3]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.406s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== connect_volume: return (1408ms) {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665646531363630', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:27:08 user nova-compute[75307]:   <uuid>a90dad03-c454-4728-a5a6-cf5759a41ed7</uuid>
Nov 13 23:27:08 user nova-compute[75307]:   <name>instance-00000016</name>
Nov 13 23:27:08 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:27:08 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:27:08 user nova-compute[75307]:   <metadata>
Nov 13 23:27:08 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:27:08 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherB-server-619339730</nova:name>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:27:07</nova:creationTime>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:27:08 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:27:08 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:owner>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:user uuid="025c402ce1bc4de7a718a2b5e119b4ae">tempest-ServerActionsTestOtherB-391883818-project-member</nova:user>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:project uuid="9031887798954fab9ea96c7ce9c30984">tempest-ServerActionsTestOtherB-391883818</nova:project>
Nov 13 23:27:08 user nova-compute[75307]:       </nova:owner>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:27:08 user nova-compute[75307]:       <nova:ports>
Nov 13 23:27:08 user nova-compute[75307]:         <nova:port uuid="47e669d9-2897-4d52-8611-36afbf74c293">
Nov 13 23:27:08 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:27:08 user nova-compute[75307]:         </nova:port>
Nov 13 23:27:08 user nova-compute[75307]:       </nova:ports>
Nov 13 23:27:08 user nova-compute[75307]:     </nova:instance>
Nov 13 23:27:08 user nova-compute[75307]:   </metadata>
Nov 13 23:27:08 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:27:08 user nova-compute[75307]:     <system>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="serial">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="uuid">a90dad03-c454-4728-a5a6-cf5759a41ed7</entry>
Nov 13 23:27:08 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:27:08 user nova-compute[75307]:     </system>
Nov 13 23:27:08 user nova-compute[75307]:   </sysinfo>
Nov 13 23:27:08 user nova-compute[75307]:   <os>
Nov 13 23:27:08 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:27:08 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:27:08 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:27:08 user nova-compute[75307]:   </os>
Nov 13 23:27:08 user nova-compute[75307]:   <features>
Nov 13 23:27:08 user nova-compute[75307]:     <acpi/>
Nov 13 23:27:08 user nova-compute[75307]:     <apic/>
Nov 13 23:27:08 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:27:08 user nova-compute[75307]:   </features>
Nov 13 23:27:08 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:27:08 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:27:08 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:27:08 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:27:08 user nova-compute[75307]:   </clock>
Nov 13 23:27:08 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:27:08 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:27:08 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:27:08 user nova-compute[75307]:   </cpu>
Nov 13 23:27:08 user nova-compute[75307]:   <devices>
Nov 13 23:27:08 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:27:08 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:27:08 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk"/>
Nov 13 23:27:08 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:27:08 user nova-compute[75307]:     </disk>
Nov 13 23:27:08 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:27:08 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:08 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:27:08 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:27:08 user nova-compute[75307]:       <serial>634bc8fe-fec1-430f-8083-7721767f4bea</serial>
Nov 13 23:27:08 user nova-compute[75307]:     </disk>
Nov 13 23:27:08 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:27:08 user nova-compute[75307]:       <mac address="fa:16:3e:0a:ba:fe"/>
Nov 13 23:27:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:27:08 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:27:08 user nova-compute[75307]:       <target dev="tap47e669d9-28"/>
Nov 13 23:27:08 user nova-compute[75307]:     </interface>
Nov 13 23:27:08 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:27:08 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/console.log" append="off"/>
Nov 13 23:27:08 user nova-compute[75307]:     </serial>
Nov 13 23:27:08 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:27:08 user nova-compute[75307]:     <video>
Nov 13 23:27:08 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:27:08 user nova-compute[75307]:     </video>
Nov 13 23:27:08 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:27:08 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:27:08 user nova-compute[75307]:     </rng>
Nov 13 23:27:08 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:27:08 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:27:08 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:27:08 user nova-compute[75307]:     </memballoon>
Nov 13 23:27:08 user nova-compute[75307]:   </devices>
Nov 13 23:27:08 user nova-compute[75307]: </domain>
Nov 13 23:27:08 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG os_vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1118dd7-4706-51ac-96ac-8a93c70820ab', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47e669d9-28, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap47e669d9-28, col_values=(('qos', UUID('c0048df7-9d55-471e-8fb2-754f8a306f90')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap47e669d9-28, col_values=(('external_ids', {'iface-id': '47e669d9-2897-4d52-8611-36afbf74c293', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:ba:fe', 'vm-uuid': 'a90dad03-c454-4728-a5a6-cf5759a41ed7'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:27:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:08 user nova-compute[75307]: INFO os_vif [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:27:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:10 user nova-compute[75307]: WARNING nova.compute.manager [req-01b98e69-6499-4ba6-9e9c-b78b10861871 req-eee9538f-827b-4f67-92fb-fa2bab350068 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state resized and task_state resize_reverting.
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:11 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:27:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance running successfully.
Nov 13 23:27:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] finish_revert_migration finished successfully. {{(pid=75307) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:12 user nova-compute[75307]: INFO nova.compute.manager [None req-1b030910-3693-4589-ab03-532ee7954dcb tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance to original state: 'active'
Nov 13 23:27:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:12 user nova-compute[75307]: WARNING nova.compute.manager [req-52cfb063-4942-4b9b-9122-096316bae489 req-14af7601-1d5d-4135-a3d2-e5c0b501c88f service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state resized and task_state resize_reverting.
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:27:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:27:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7310MB free_disk=25.169509887695312GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance d27f63dd-33ee-418f-90bc-297622ae340b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 25c8b300-4c7b-4370-b014-41b0085dc217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:27:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [{"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-11cd5b9d-7bb2-4492-8031-a9676c288140" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:27:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d27f63dd-33ee-418f-90bc-297622ae340b is timed out.
Nov 13 23:27:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdb from instance d27f63dd-33ee-418f-90bc-297622ae340b from the live domain config.
Nov 13 23:27:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuWqUIy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:21 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[793b1f5e-eba3-471f-a134-c132b3df58a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:27:21 user nova-compute[75307]: No targets found.
Nov 13 23:27:21 user nova-compute[75307]: iSNS:
Nov 13 23:27:21 user nova-compute[75307]: No targets found.
Nov 13 23:27:21 user nova-compute[75307]: STATIC:
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:27:21 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:21 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:21 user nova-compute[75307]: FIRMWARE:
Nov 13 23:27:21 user nova-compute[75307]: No targets found.
Nov 13 23:27:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:27:21 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:27:21 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[389072ef-1482-4a42-9619-cce627627945]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7729ad00-df9c-4049-9991-8e47c90e2242]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:21 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:21 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb343556c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1ca6ab-8b91-4230-8223-edaf550bb64d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4e0321-4993-4879-99bb-3c93e0270b8d]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5a0bb89-e1d3-446c-9542-89e1242514d5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3caecb-bed1-425a-a8d2-465d1cb0c3d4]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a8e3b-4dcd-4cff-b7bd-ed0f8f68ad2a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1865588a-45b8-4099-a3f7-e7ecf099968d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260]
Nov 13 23:27:22 user nova-compute[75307]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d2209e8c-296b-4e73-bb5d-2f7fe2dc0bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5630837-227a-4149-8df8-a49ded801740]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== disconnect_volume: return (342ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fbc93c45-2b9b-4cff-b9bf-dd1d0595d199 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.662s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:23 user nova-compute[75307]: INFO nova.compute.manager [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Detaching volume 32bf12cf-038d-4df5-b811-c91f87502fe3
Nov 13 23:27:23 user nova-compute[75307]: INFO nova.virt.block_device [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Attempting to driver detach volume 32bf12cf-038d-4df5-b811-c91f87502fe3 from mountpoint /dev/vdc
Nov 13 23:27:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Attempting to detach device vdc from instance d27f63dd-33ee-418f-90bc-297622ae340b from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:27:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:23 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:23 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:27:23 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:27:23 user nova-compute[75307]:   <serial>32bf12cf-038d-4df5-b811-c91f87502fe3</serial>
Nov 13 23:27:23 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:27:23 user nova-compute[75307]: </disk>
Nov 13 23:27:23 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:23 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdc from instance d27f63dd-33ee-418f-90bc-297622ae340b from the persistent domain config.
Nov 13 23:27:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance d27f63dd-33ee-418f-90bc-297622ae340b from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:27:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:23 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:23 user nova-compute[75307]:   <source dev="/dev/sdg"/>
Nov 13 23:27:23 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:27:23 user nova-compute[75307]:   <serial>32bf12cf-038d-4df5-b811-c91f87502fe3</serial>
Nov 13 23:27:23 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 13 23:27:23 user nova-compute[75307]: </disk>
Nov 13 23:27:23 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing instance network info cache due to event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] Acquiring lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] Acquired lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updated VIF entry in instance network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c5e337ea-482e-436a-ac12-2d3d12e266d9 req-343c3230-91bc-4dbf-8493-e3b0cd1262ac service nova] Releasing lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.objects.instance [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:25 user nova-compute[75307]: INFO nova.compute.manager [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Attaching volume 04bf96d6-41b2-4105-9a7d-17adf24f2c22 to /dev/vdb
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca0a53-8199-49e7-86af-6c30c996ed67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f18a95b-aceb-434d-a18c-9110c1e00578]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34474ff-de60-4d91-86e3-26ba90c68b18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4074a0d7-e404-4129-a81d-6274cb2750cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:27:25 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:27:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5aed3e5-db90-41d9-b639-a5eb4926d586]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:25 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating existing volume attachment record: 0042bdc0-45fe-47a2-be90-6f0e30fa9424 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:27:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsbJYZLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:30 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfc8dca-c653-44f1-a292-000d484f2676]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:27:30 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72365df-b6cd-45f3-98e3-161ebad98f66]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22] added
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5a3eb-2148-48e6-a9bc-3af6f5248810]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42fa7af-3ff2-45bb-9995-c4b6b8fc17ef]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsbJYZLW {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OsbJYZLW" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf27e8fe-5f4d-4be9-98d1-ccb8379c6686]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OsbJYZLW'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd2c70-1525-495e-8fe5-68e338f1eb3e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[74be1d5c-cc41-4084-a654-997f09394c6a]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80250a6-3839-4461-aa22-d8c5eb47c8a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260]
Nov 13 23:27:30 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f760640-6158-430a-a4b4-0c17b443d9a4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b707a31-474a-4b26-8cdc-2ea0b2aed21d]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:30 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dff1cdc-eec3-4a91-b9b9-a5dac77e35c8]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:27:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsbJYZLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23939303063323066', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939303063323066', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:27:31 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:31 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:27:31 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:31 user nova-compute[75307]:   <serial>04bf96d6-41b2-4105-9a7d-17adf24f2c22</serial>
Nov 13 23:27:31 user nova-compute[75307]: </disk>
Nov 13 23:27:31 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:27:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] No VIF found with MAC fa:16:3e:a2:c7:e4, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:27:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2e411394-3f5e-4612-a143-7c4dbe4f5d81 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.334s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:33 user nova-compute[75307]: INFO nova.compute.manager [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Detaching volume 04bf96d6-41b2-4105-9a7d-17adf24f2c22
Nov 13 23:27:33 user nova-compute[75307]: INFO nova.virt.block_device [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Attempting to driver detach volume 04bf96d6-41b2-4105-9a7d-17adf24f2c22 from mountpoint /dev/vdb
Nov 13 23:27:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Attempting to detach device vdb from instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:27:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:33 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:33 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:27:33 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:33 user nova-compute[75307]:   <serial>04bf96d6-41b2-4105-9a7d-17adf24f2c22</serial>
Nov 13 23:27:33 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:27:33 user nova-compute[75307]: </disk>
Nov 13 23:27:33 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:33 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully detached device vdb from instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a from the persistent domain config.
Nov 13 23:27:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:27:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:33 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:33 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:27:33 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:33 user nova-compute[75307]:   <serial>04bf96d6-41b2-4105-9a7d-17adf24f2c22</serial>
Nov 13 23:27:33 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:27:33 user nova-compute[75307]: </disk>
Nov 13 23:27:33 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:27:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:39 user nova-compute[75307]: INFO nova.compute.manager [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Detaching volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:27:39 user nova-compute[75307]: INFO nova.virt.block_device [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Attempting to driver detach volume 5bb0dbe6-7f66-4e20-9218-509ff7cb5168 from mountpoint /dev/vdb
Nov 13 23:27:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Attempting to detach device vdb from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:27:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:39 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:39 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:27:39 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:39 user nova-compute[75307]:   <serial>5bb0dbe6-7f66-4e20-9218-509ff7cb5168</serial>
Nov 13 23:27:39 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:27:39 user nova-compute[75307]: </disk>
Nov 13 23:27:39 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:39 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully detached device vdb from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the persistent domain config.
Nov 13 23:27:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:27:39 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:27:39 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:27:39 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:27:39 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:27:39 user nova-compute[75307]:   <serial>5bb0dbe6-7f66-4e20-9218-509ff7cb5168</serial>
Nov 13 23:27:39 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:27:39 user nova-compute[75307]: </disk>
Nov 13 23:27:39 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:27:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:27:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance d27f63dd-33ee-418f-90bc-297622ae340b is timed out.
Nov 13 23:27:44 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully detached device vdc from instance d27f63dd-33ee-418f-90bc-297622ae340b from the live domain config.
Nov 13 23:27:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eYLiDoMu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:44 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[837b9323-2930-4326-aba0-594b11ecb0d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:27:44 user nova-compute[75307]: No targets found.
Nov 13 23:27:44 user nova-compute[75307]: iSNS:
Nov 13 23:27:44 user nova-compute[75307]: No targets found.
Nov 13 23:27:44 user nova-compute[75307]: STATIC:
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:27:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:44 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:44 user nova-compute[75307]: FIRMWARE:
Nov 13 23:27:44 user nova-compute[75307]: No targets found.
Nov 13 23:27:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:27:44 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:27:44 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa2256c-6495-48a0-8994-b3abc072307c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e6422b-1b8d-4b9f-9787-c6dffd0f764b]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:44 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c305090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3'): ({'sdg'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Removing single pathed devices sdg {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5320f76c-db6e-4121-8e9a-ed12443d943a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7225a199-022c-4443-84e2-a0e3fee775d6]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Flushing IO for device /dev/sdg {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2b1c4d-e993-4c5f-bbaa-971d728d9b9b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.046s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b296bab5-4a40-4fe8-9b4a-5f937d931dab]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] SCSI volumes sdg have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48271d51-8e05-459c-b1a9-96ed03a58e79]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18047476-ca62-4ef8-afd2-e82fa695f47b]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260]
Nov 13 23:27:44 user nova-compute[75307]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32bf12cf-038d-4df5-b811-c91f87502fe3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c63acb2-3539-4c30-8023-d93f3ca07fc5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] <== disconnect_volume: return (354ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:27:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'flavor' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ec9fe045-d752-48d6-95d8-cb27cf038492 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.816s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:46 user nova-compute[75307]: INFO nova.compute.manager [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Terminating instance
Nov 13 23:27:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-unplugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] No waiting events found dispatching network-vif-unplugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-26d2f188-088b-489d-bc47-dabce9a28822 req-5f142914-419a-4f96-b5e1-07cd304d5c5d service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-unplugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:27:47 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Instance destroyed successfully.
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lazy-loading 'resources' on Instance uuid d27f63dd-33ee-418f-90bc-297622ae340b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:24:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-233527754',display_name='tempest-AttachVolumeTestJSON-server-233527754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-233527754',id=28,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNa5wVL5UYmQCg0wanAYFgHh0f9CP5o1QTmVv4DVgCOZvEwCFkN7a3H8lFzyn+B4cspsTP0qdSQPwqiL5Y5WopmP4RGuYzwQ+Lsa9SrkJHcJeqyhVnSLy5KMcJhFSp0rA==',key_name='tempest-keypair-972638700',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e387a1f37b944329bb8f097e8f4ec56b',ramdisk_id='',reservation_id='r-dcnnuetd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1230084994',owner_user_name='tempest-AttachVolumeTestJSON-1230084994-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:25:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19d8c9bb553d4995bc62521ef2b8bf0b',uuid=d27f63dd-33ee-418f-90bc-297622ae340b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converting VIF {"id": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "address": "fa:16:3e:41:37:9d", "network": {"id": "0789b1ec-de79-4aa2-bc23-4086252c5fc6", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-577871348-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e387a1f37b944329bb8f097e8f4ec56b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap295a9e27-b8", "ovs_interfaceid": "295a9e27-b825-484b-bfd9-a947cb2e8a13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG os_vif [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap295a9e27-b8, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=114a7224-0f1a-4d5a-a5de-5ddbc3028242) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:47 user nova-compute[75307]: INFO os_vif [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:37:9d,bridge_name='br-int',has_traffic_filtering=True,id=295a9e27-b825-484b-bfd9-a947cb2e8a13,network=Network(0789b1ec-de79-4aa2-bc23-4086252c5fc6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap295a9e27-b8')
Nov 13 23:27:47 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Deleting instance files /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b_del
Nov 13 23:27:47 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Deletion of /opt/stack/data/nova/instances/d27f63dd-33ee-418f-90bc-297622ae340b_del complete
Nov 13 23:27:47 user nova-compute[75307]: INFO nova.compute.manager [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 23:27:47 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:27:47 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:27:48 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:27:48 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Took 0.68 seconds to deallocate network for instance.
Nov 13 23:27:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:48 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:27:48 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:27:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:48 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Deleted allocations for instance d27f63dd-33ee-418f-90bc-297622ae340b
Nov 13 23:27:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a0d4202a-c0c3-4a65-93e5-af2a9dddc8f8 tempest-AttachVolumeTestJSON-1230084994 tempest-AttachVolumeTestJSON-1230084994-project-member] Lock "d27f63dd-33ee-418f-90bc-297622ae340b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.084s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] Acquiring lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:27:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:27:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] Lock "d27f63dd-33ee-418f-90bc-297622ae340b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] No waiting events found dispatching network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:27:49 user nova-compute[75307]: WARNING nova.compute.manager [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received unexpected event network-vif-plugged-295a9e27-b825-484b-bfd9-a947cb2e8a13 for instance with vm_state deleted and task_state None.
Nov 13 23:27:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-8e4aebd0-cfe3-4f2f-8392-44e17b3686dd req-63e636ab-28f8-4a41-ad98-a799df899be5 service nova] [instance: d27f63dd-33ee-418f-90bc-297622ae340b] Received event network-vif-deleted-295a9e27-b825-484b-bfd9-a947cb2e8a13 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:27:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:54 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a is timed out.
Nov 13 23:27:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully detached device vdb from instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a from the live domain config.
Nov 13 23:27:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OsbJYZLW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:27:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10dd7f6a-aadf-4613-8d25-f1940309a33f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:27:54 user nova-compute[75307]: No targets found.
Nov 13 23:27:54 user nova-compute[75307]: iSNS:
Nov 13 23:27:54 user nova-compute[75307]: No targets found.
Nov 13 23:27:54 user nova-compute[75307]: STATIC:
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:27:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:27:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:27:54 user nova-compute[75307]: FIRMWARE:
Nov 13 23:27:54 user nova-compute[75307]: No targets found.
Nov 13 23:27:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:27:54 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:27:54 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3af8aa1-17e1-44c7-8935-cb2563d739ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[144c7dd8-9f22-4a2a-b734-f58cef82d840]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0a8fc706-1f7f-4c2d-bcfb-4d7c22d2d502 (non-flash)
Nov 13 23:27:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c11ba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f0e362-065a-4bb5-8c3f-84a7daca82a6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d561ab63-d67a-4c4f-80cb-91950a97267a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0017c4-c29b-4df8-974e-c61397d362f9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d71b7f4-ef9c-415f-9202-77e32be307ad]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7586b9bd-0a11-4e67-8d18-b6ae5d4e491d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf37abf-4f99-46c9-8afd-3b91a3f65bce]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260]
Nov 13 23:27:54 user nova-compute[75307]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22, portal: 172.16.0.220,3260] successful.
Nov 13 23:27:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04bf96d6-41b2-4105-9a7d-17adf24f2c22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfa3da2-1c10-4f0e-8787-a5ad957b5f64]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] <== disconnect_volume: return (338ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:27:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:27:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'flavor' on Instance uuid 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:27:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c1d4b91e-6841-4d6f-942e-82b18586866e tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.671s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:27:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:27:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 is timed out.
Nov 13 23:28:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully detached device vdb from instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 from the live domain config.
Nov 13 23:28:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ovstHaVA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:28:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88fcef2-cd07-4f7a-97fb-0f8a27fafcbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:28:00 user nova-compute[75307]: No targets found.
Nov 13 23:28:00 user nova-compute[75307]: iSNS:
Nov 13 23:28:00 user nova-compute[75307]: No targets found.
Nov 13 23:28:00 user nova-compute[75307]: STATIC:
Nov 13 23:28:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168
Nov 13 23:28:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:28:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:28:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:28:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:00 user nova-compute[75307]: FIRMWARE:
Nov 13 23:28:00 user nova-compute[75307]: No targets found.
Nov 13 23:28:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:28:00 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:28:00 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7ccb7-b780-48c2-9154-01d2dff6bdfe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e7eda6-4a57-475b-a0e1-355a2a056b15]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:00 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c118820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82836048-968d-4e69-8f2e-979ffc6eab87]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abe7f3d-c12f-4fa8-a91b-eda4c2109012]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaae3a00-42cb-4485-8565-60fdba782a8a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed87c18a-7ab3-4fd4-8b58-0774c733b1f8]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72a3682-35dd-4e52-a0d8-ac8fa9df7c3c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[386ad145-81e5-4f0d-bb6d-3daaa20cbc9c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260]
Nov 13 23:28:00 user nova-compute[75307]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168, portal: 172.16.0.220,3260] successful.
Nov 13 23:28:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5bb0dbe6-7f66-4e20-9218-509ff7cb5168 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8636decb-49d9-4ee9-9d28-fedfe075f9e6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== disconnect_volume: return (321ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:28:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:28:01 user nova-compute[75307]: DEBUG nova.objects.instance [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'flavor' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-8b6c948c-9712-4805-85a5-8be944128208 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.650s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing instance network info cache due to event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] Acquiring lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] Acquired lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updated VIF entry in instance network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG nova.network.neutron [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4c5882ef-2d4f-4c68-b4d2-1e66327a3c48 req-a5874c14-ee9f-41d6-8570-444667f9ef63 service nova] Releasing lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:14 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing instance network info cache due to event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:17 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7635MB free_disk=25.185260772705078GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6a7736a-5973-40cd-8e8e-0404353941c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 25c8b300-4c7b-4370-b014-41b0085dc217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:17 user nova-compute[75307]: INFO nova.compute.manager [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Detaching volume 7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:28:17 user nova-compute[75307]: INFO nova.virt.block_device [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Attempting to driver detach volume 7c646ffa-1e24-4c18-bfd5-7065a4f5a42f from mountpoint /dev/vdb
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Attempting to detach device vdb from instance f6a7736a-5973-40cd-8e8e-0404353941c1 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:28:17 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:28:17 user nova-compute[75307]:   <source dev="/dev/sdf"/>
Nov 13 23:28:17 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:28:17 user nova-compute[75307]:   <serial>7c646ffa-1e24-4c18-bfd5-7065a4f5a42f</serial>
Nov 13 23:28:17 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:28:17 user nova-compute[75307]: </disk>
Nov 13 23:28:17 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:28:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully detached device vdb from instance f6a7736a-5973-40cd-8e8e-0404353941c1 from the persistent domain config.
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f6a7736a-5973-40cd-8e8e-0404353941c1 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:28:17 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:28:17 user nova-compute[75307]:   <source dev="/dev/sdf"/>
Nov 13 23:28:17 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:28:17 user nova-compute[75307]:   <serial>7c646ffa-1e24-4c18-bfd5-7065a4f5a42f</serial>
Nov 13 23:28:17 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:28:17 user nova-compute[75307]: </disk>
Nov 13 23:28:17 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updated VIF entry in instance network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76ebd781-1cd4-45f9-bd79-bbb253750ef3 req-0372ee78-91dd-45ef-b6ae-2bfc44bd298c service nova] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:28:17 user nova-compute[75307]: INFO nova.compute.claims [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Claim successful on node user
Nov 13 23:28:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:28:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.policy [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '119a5d0012a44e1a8fb19a781aed09ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f7dd660313a41b9a468835b35ceca8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:18 user nova-compute[75307]: INFO nova.virt.block_device [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Booting with volume 6dfe4c3e-2611-4538-8d8e-d6f9aa936981 at /dev/vda
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:28:18 user nova-compute[75307]: INFO nova.compute.claims [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Claim successful on node user
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.utils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d19464-748f-49b4-8d9a-1548881028f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[853da3cc-8895-46f0-9a2a-7e9c3c371031]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f99a001-bb17-404c-a472-cc6f33e30b5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0fc0ca-4dd7-4044-bf2a-e1b337e77282]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:28:18 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06cf9bb-9d3f-42e6-9e97-ee3abb6ec906]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG os_brick.utils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating existing volume attachment record: 28cfab4a-07e1-4260-b2d8-f2c036ab1b67 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing instance network info cache due to event network-changed-4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] Acquiring lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] Acquired lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Refreshing network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:28:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:28:18 user nova-compute[75307]: DEBUG nova.policy [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9f09950b58c343f8b8684ab68aeb6f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd367a26c5f3e408caeb0ffa8311f3d14', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:28:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Creating image(s)
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "/opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "/opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Successfully created port: 4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [{"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk 1073741824" returned: 0 in 0.055s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Cannot resize image /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Ensure instance console log exists: /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updated VIF entry in instance network info cache for port 4ceb2d7f-b19c-4adc-b4e4-98aed704f613. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [{"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-277c5f5f-d027-4717-83ea-623ce1c0c6f9 req-9c134bab-bfbb-4b32-9531-c9780b20d4dc service nova] Releasing lock "refresh_cache-f6a7736a-5973-40cd-8e8e-0404353941c1" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Successfully created port: d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Successfully updated port: 4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquired lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing instance network info cache due to event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] Acquiring lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating instance_info_cache with network_info: [{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Releasing lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Instance network_info: |[{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] Acquired lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Successfully updated port: d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquired lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updated VIF entry in instance network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating instance_info_cache with network_info: [{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7dafa4e8-850f-4ea0-88d9-cd5625b7bb19 req-c2f70852-1229-46c9-8042-96c49c8761e6 service nova] Releasing lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Updating instance_info_cache with network_info: [{"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Releasing lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Instance network_info: |[{"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Start _get_guest_xml network_info=[{"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:28:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1169228286',display_name='tempest-ServersNegativeTestJSON-server-1169228286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1169228286',id=33,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-za8d7jhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:19Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=0b28d902-aa7f-4da7-a8e2-68b02eeadfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:28:22 user nova-compute[75307]:   <uuid>0b28d902-aa7f-4da7-a8e2-68b02eeadfe2</uuid>
Nov 13 23:28:22 user nova-compute[75307]:   <name>instance-00000021</name>
Nov 13 23:28:22 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:28:22 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:28:22 user nova-compute[75307]:   <metadata>
Nov 13 23:28:22 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:28:22 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:name>tempest-ServersNegativeTestJSON-server-1169228286</nova:name>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:28:21</nova:creationTime>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:28:22 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:28:22 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:owner>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:user uuid="9f09950b58c343f8b8684ab68aeb6f97">tempest-ServersNegativeTestJSON-1320604312-project-member</nova:user>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:project uuid="d367a26c5f3e408caeb0ffa8311f3d14">tempest-ServersNegativeTestJSON-1320604312</nova:project>
Nov 13 23:28:22 user nova-compute[75307]:       </nova:owner>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:28:22 user nova-compute[75307]:       <nova:ports>
Nov 13 23:28:22 user nova-compute[75307]:         <nova:port uuid="d586ea61-4f5f-4d79-8555-a93b59472857">
Nov 13 23:28:22 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:28:22 user nova-compute[75307]:         </nova:port>
Nov 13 23:28:22 user nova-compute[75307]:       </nova:ports>
Nov 13 23:28:22 user nova-compute[75307]:     </nova:instance>
Nov 13 23:28:22 user nova-compute[75307]:   </metadata>
Nov 13 23:28:22 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:28:22 user nova-compute[75307]:     <system>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="serial">0b28d902-aa7f-4da7-a8e2-68b02eeadfe2</entry>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="uuid">0b28d902-aa7f-4da7-a8e2-68b02eeadfe2</entry>
Nov 13 23:28:22 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:28:22 user nova-compute[75307]:     </system>
Nov 13 23:28:22 user nova-compute[75307]:   </sysinfo>
Nov 13 23:28:22 user nova-compute[75307]:   <os>
Nov 13 23:28:22 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:28:22 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:28:22 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:28:22 user nova-compute[75307]:   </os>
Nov 13 23:28:22 user nova-compute[75307]:   <features>
Nov 13 23:28:22 user nova-compute[75307]:     <acpi/>
Nov 13 23:28:22 user nova-compute[75307]:     <apic/>
Nov 13 23:28:22 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:28:22 user nova-compute[75307]:   </features>
Nov 13 23:28:22 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:28:22 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:28:22 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:28:22 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:28:22 user nova-compute[75307]:   </clock>
Nov 13 23:28:22 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:28:22 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:28:22 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:28:22 user nova-compute[75307]:   </cpu>
Nov 13 23:28:22 user nova-compute[75307]:   <devices>
Nov 13 23:28:22 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:28:22 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:28:22 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk"/>
Nov 13 23:28:22 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:28:22 user nova-compute[75307]:     </disk>
Nov 13 23:28:22 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:28:22 user nova-compute[75307]:       <mac address="fa:16:3e:c0:ee:8b"/>
Nov 13 23:28:22 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:28:22 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:28:22 user nova-compute[75307]:       <target dev="tapd586ea61-4f"/>
Nov 13 23:28:22 user nova-compute[75307]:     </interface>
Nov 13 23:28:22 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:28:22 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/console.log" append="off"/>
Nov 13 23:28:22 user nova-compute[75307]:     </serial>
Nov 13 23:28:22 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:28:22 user nova-compute[75307]:     <video>
Nov 13 23:28:22 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:28:22 user nova-compute[75307]:     </video>
Nov 13 23:28:22 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:28:22 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:28:22 user nova-compute[75307]:     </rng>
Nov 13 23:28:22 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:28:22 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:28:22 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:28:22 user nova-compute[75307]:     </memballoon>
Nov 13 23:28:22 user nova-compute[75307]:   </devices>
Nov 13 23:28:22 user nova-compute[75307]: </domain>
Nov 13 23:28:22 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1169228286',display_name='tempest-ServersNegativeTestJSON-server-1169228286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1169228286',id=33,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-za8d7jhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:19Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=0b28d902-aa7f-4da7-a8e2-68b02eeadfe2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_vif [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '042d52a9-94ea-58e3-ba61-f151aefcb052', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd586ea61-4f, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd586ea61-4f, col_values=(('qos', UUID('003ac1f9-cde1-4533-a567-43c42e096966')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd586ea61-4f, col_values=(('external_ids', {'iface-id': 'd586ea61-4f5f-4d79-8555-a93b59472857', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:ee:8b', 'vm-uuid': '0b28d902-aa7f-4da7-a8e2-68b02eeadfe2'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: INFO os_vif [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f')
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] No VIF found with MAC fa:16:3e:c0:ee:8b, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-changed-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Refreshing instance network info cache due to event network-changed-d586ea61-4f5f-4d79-8555-a93b59472857. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] Acquiring lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] Acquired lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Refreshing network info cache for port d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:28:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Creating image(s)
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Ensure instance console log exists: /opt/stack/data/nova/instances/fc0198dc-a30f-4172-810e-0b8b2e10a110/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Start _get_guest_xml network_info=[{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiENqlTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc0198dc-a30f-4172-810e-0b8b2e10a110', 'attached_at': '', 'detached_at': '', 'volume_id': '6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 'serial': '6dfe4c3e-2611-4538-8d8e-d6f9aa936981'}, 'delete_on_termination': False, 'attachment_id': '28cfab4a-07e1-4260-b2d8-f2c036ab1b67', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:28:22 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:22 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiENqlTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:28:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:28:22 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:28:22 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae17df32-5147-4d12-be5c-94d51aaf2e85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:28:22 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed779a1-d1f7-4828-9abf-997b500fd23d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981] added
Nov 13 23:28:22 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Updated VIF entry in instance network info cache for port d586ea61-4f5f-4d79-8555-a93b59472857. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG nova.network.neutron [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Updating instance_info_cache with network_info: [{"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e010b25b-fa34-45ed-bac4-76333596c4e7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c97d363-4734-4895-af12-d0065e2bffaf req-bcc7399e-8ca0-46f3-b474-9c6aa1341839 service nova] Releasing lock "refresh_cache-0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ea54be-f7fa-44cd-88c7-77a7ebfcab70]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiENqlTX {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YiENqlTX" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f73cfdc-cc48-46c1-9c9a-c4e240827e81]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YiENqlTX'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f9047f-3734-4083-95b6-0f30075ab29c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8f8806-17a8-4770-b96c-c9c09efc0666]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d31fa7-1697-442a-913c-f2f788e54d3a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260]
Nov 13 23:28:23 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260] successful.
Nov 13 23:28:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8518a1e9-6ece-4c7e-ac1c-427628b3d058]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f33ad01-6f25-4e71-9468-3d12f7cc4884]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:23 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:28:23 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] HCTL ('34', '-', '-', 0) found on session 45 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a057a64-1c56-4d03-a82e-c4deff6cf229]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Searching for a device in session 45 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiENqlTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] No waiting events found dispatching network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:23 user nova-compute[75307]: WARNING nova.compute.manager [req-a78ea927-3d55-4566-b60f-6b8507a04799 req-4ee137ed-43ca-4775-ad03-4c617e0b4cd4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received unexpected event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 for instance with vm_state building and task_state spawning.
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing instance network info cache due to event network-changed-55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] Acquiring lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] Acquired lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Refreshing network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '26263613730646531', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263613730646531', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335464581',display_name='tempest-TestVolumeBootPattern-server-335464581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335464581',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-4k0iag31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:18Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=fc0198dc-a30f-4172-810e-0b8b2e10a110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.objects.instance [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'pci_devices' on Instance uuid fc0198dc-a30f-4172-810e-0b8b2e10a110 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:28:24 user nova-compute[75307]:   <uuid>fc0198dc-a30f-4172-810e-0b8b2e10a110</uuid>
Nov 13 23:28:24 user nova-compute[75307]:   <name>instance-00000020</name>
Nov 13 23:28:24 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:28:24 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:28:24 user nova-compute[75307]:   <metadata>
Nov 13 23:28:24 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:28:24 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:28:24 user nova-compute[75307]:       <nova:name>tempest-TestVolumeBootPattern-server-335464581</nova:name>
Nov 13 23:28:24 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:28:22</nova:creationTime>
Nov 13 23:28:24 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:28:24 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:28:24 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:28:24 user nova-compute[75307]:       <nova:owner>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:user uuid="119a5d0012a44e1a8fb19a781aed09ce">tempest-TestVolumeBootPattern-234629115-project-member</nova:user>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:project uuid="2f7dd660313a41b9a468835b35ceca8b">tempest-TestVolumeBootPattern-234629115</nova:project>
Nov 13 23:28:24 user nova-compute[75307]:       </nova:owner>
Nov 13 23:28:24 user nova-compute[75307]:       <nova:ports>
Nov 13 23:28:24 user nova-compute[75307]:         <nova:port uuid="4ee1c324-878e-42e7-bd3a-e7484defdb32">
Nov 13 23:28:24 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 13 23:28:24 user nova-compute[75307]:         </nova:port>
Nov 13 23:28:24 user nova-compute[75307]:       </nova:ports>
Nov 13 23:28:24 user nova-compute[75307]:     </nova:instance>
Nov 13 23:28:24 user nova-compute[75307]:   </metadata>
Nov 13 23:28:24 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:28:24 user nova-compute[75307]:     <system>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="serial">fc0198dc-a30f-4172-810e-0b8b2e10a110</entry>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="uuid">fc0198dc-a30f-4172-810e-0b8b2e10a110</entry>
Nov 13 23:28:24 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:28:24 user nova-compute[75307]:     </system>
Nov 13 23:28:24 user nova-compute[75307]:   </sysinfo>
Nov 13 23:28:24 user nova-compute[75307]:   <os>
Nov 13 23:28:24 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:28:24 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:28:24 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:28:24 user nova-compute[75307]:   </os>
Nov 13 23:28:24 user nova-compute[75307]:   <features>
Nov 13 23:28:24 user nova-compute[75307]:     <acpi/>
Nov 13 23:28:24 user nova-compute[75307]:     <apic/>
Nov 13 23:28:24 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:28:24 user nova-compute[75307]:   </features>
Nov 13 23:28:24 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:28:24 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:28:24 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:28:24 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:28:24 user nova-compute[75307]:   </clock>
Nov 13 23:28:24 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:28:24 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:28:24 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:28:24 user nova-compute[75307]:   </cpu>
Nov 13 23:28:24 user nova-compute[75307]:   <devices>
Nov 13 23:28:24 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:28:24 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:28:24 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:28:24 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:28:24 user nova-compute[75307]:       <serial>6dfe4c3e-2611-4538-8d8e-d6f9aa936981</serial>
Nov 13 23:28:24 user nova-compute[75307]:     </disk>
Nov 13 23:28:24 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:28:24 user nova-compute[75307]:       <mac address="fa:16:3e:2f:6c:d0"/>
Nov 13 23:28:24 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:28:24 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:28:24 user nova-compute[75307]:       <target dev="tap4ee1c324-87"/>
Nov 13 23:28:24 user nova-compute[75307]:     </interface>
Nov 13 23:28:24 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:28:24 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/fc0198dc-a30f-4172-810e-0b8b2e10a110/console.log" append="off"/>
Nov 13 23:28:24 user nova-compute[75307]:     </serial>
Nov 13 23:28:24 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:28:24 user nova-compute[75307]:     <video>
Nov 13 23:28:24 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:28:24 user nova-compute[75307]:     </video>
Nov 13 23:28:24 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:28:24 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:28:24 user nova-compute[75307]:     </rng>
Nov 13 23:28:24 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:28:24 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:28:24 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:28:24 user nova-compute[75307]:     </memballoon>
Nov 13 23:28:24 user nova-compute[75307]:   </devices>
Nov 13 23:28:24 user nova-compute[75307]: </domain>
Nov 13 23:28:24 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335464581',display_name='tempest-TestVolumeBootPattern-server-335464581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335464581',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-4k0iag31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:18Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=fc0198dc-a30f-4172-810e-0b8b2e10a110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG os_vif [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e87c58b-f88d-55fe-8b19-b0a3684b0c20', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:24 user nova-compute[75307]: INFO nova.compute.manager [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Terminating instance
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ee1c324-87, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ee1c324-87, col_values=(('qos', UUID('a2acca64-9d91-40bc-aaa2-0f35d38bdb6a')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ee1c324-87, col_values=(('external_ids', {'iface-id': '4ee1c324-878e-42e7-bd3a-e7484defdb32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:6c:d0', 'vm-uuid': 'fc0198dc-a30f-4172-810e-0b8b2e10a110'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: INFO os_vif [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87')
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] No VIF found with MAC fa:16:3e:2f:6c:d0, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updated VIF entry in instance network info cache for port 55db98cd-baed-4f71-9e0e-2b10eb3d0384. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [{"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-707e1795-eafc-461c-906e-f6a9d98ccf0c req-29c2189b-b29f-41de-b52c-9f87b467917a service nova] Releasing lock "refresh_cache-19e90d5b-1bf4-4f35-83ae-8738ee6f206a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Instance destroyed successfully.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.objects.instance [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'resources' on Instance uuid 19e90d5b-1bf4-4f35-83ae-8738ee6f206a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:25:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-934635618',display_name='tempest-TestStampPattern-server-934635618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-934635618',id=29,image_ref='18da43ed-7578-42da-a308-de7e4ca53067',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-jv3zm364',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='f6233ac6-5054-48b9-94cf-607e2b2b28e9',image_min_disk='1',image_min_ram='0',image_owner_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',image_owner_project_name='tempest-TestStampPattern-1908061242',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1908061242-project-member',image_user_id='519cf74c92b9446a9c644f45f3909253',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:25:40Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=19e90d5b-1bf4-4f35-83ae-8738ee6f206a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "address": "fa:16:3e:a2:c7:e4", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap55db98cd-ba", "ovs_interfaceid": "55db98cd-baed-4f71-9e0e-2b10eb3d0384", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG os_vif [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap55db98cd-ba, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28fd92b2-fbd3-4b8a-85f9-b0ab7e56c0b0) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: INFO os_vif [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a2:c7:e4,bridge_name='br-int',has_traffic_filtering=True,id=55db98cd-baed-4f71-9e0e-2b10eb3d0384,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap55db98cd-ba')
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Deleting instance files /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a_del
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Deletion of /opt/stack/data/nova/instances/19e90d5b-1bf4-4f35-83ae-8738ee6f206a_del complete
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.compute.manager [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Instance spawned successfully.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Took 6.68 seconds to spawn the instance on the hypervisor.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] No waiting events found dispatching network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:25 user nova-compute[75307]: WARNING nova.compute.manager [req-ae3c4c92-412d-4bba-9b8d-320a75d2e40f req-19af7cf6-307f-4938-b7c4-c8e8287b5fb4 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received unexpected event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 for instance with vm_state building and task_state spawning.
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.compute.manager [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Took 7.59 seconds to build instance.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-39a72848-0c48-45f8-a5df-7246ace8e40c tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.691s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Took 0.48 seconds to deallocate network for instance.
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-aa3fd67b-8077-4c3d-a1f3-bb48d27e3554 req-cc5ed15f-967d-44a2-8607-90c7c34570de service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-vif-deleted-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:25 user nova-compute[75307]: INFO nova.compute.manager [req-aa3fd67b-8077-4c3d-a1f3-bb48d27e3554 req-cc5ed15f-967d-44a2-8607-90c7c34570de service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Neutron deleted interface 55db98cd-baed-4f71-9e0e-2b10eb3d0384; detaching it from the instance and deleting it from the info cache
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.network.neutron [req-aa3fd67b-8077-4c3d-a1f3-bb48d27e3554 req-cc5ed15f-967d-44a2-8607-90c7c34570de service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG nova.compute.manager [req-aa3fd67b-8077-4c3d-a1f3-bb48d27e3554 req-cc5ed15f-967d-44a2-8607-90c7c34570de service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Detach interface failed, port_id=55db98cd-baed-4f71-9e0e-2b10eb3d0384, reason: Instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-vif-unplugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] No waiting events found dispatching network-vif-unplugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:26 user nova-compute[75307]: WARNING nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received unexpected event network-vif-unplugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 for instance with vm_state deleted and task_state None.
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Acquiring lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] No waiting events found dispatching network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:26 user nova-compute[75307]: WARNING nova.compute.manager [req-4dd07735-6e39-4c2c-8835-a7f95f4940c7 req-d866333d-ec02-4600-b11e-f56d570c30ba service nova] [instance: 19e90d5b-1bf4-4f35-83ae-8738ee6f206a] Received unexpected event network-vif-plugged-55db98cd-baed-4f71-9e0e-2b10eb3d0384 for instance with vm_state deleted and task_state None.
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:26 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Deleted allocations for instance 19e90d5b-1bf4-4f35-83ae-8738ee6f206a
Nov 13 23:28:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cb24044f-0ee4-4eb3-a8b1-2930c56a700f tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "19e90d5b-1bf4-4f35-83ae-8738ee6f206a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] No waiting events found dispatching network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:27 user nova-compute[75307]: WARNING nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received unexpected event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 for instance with vm_state building and task_state spawning.
Nov 13 23:28:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] No waiting events found dispatching network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:27 user nova-compute[75307]: WARNING nova.compute.manager [req-343298aa-d134-4e40-80fe-f3f15a4747eb req-06cf6026-49f5-4cc8-b7c9-e05845ca74d1 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received unexpected event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 for instance with vm_state building and task_state spawning.
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:28:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Instance spawned successfully.
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:28:28 user nova-compute[75307]: INFO nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Took 5.37 seconds to spawn the instance on the hypervisor.
Nov 13 23:28:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:28:28 user nova-compute[75307]: INFO nova.compute.manager [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Took 10.66 seconds to build instance.
Nov 13 23:28:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-bd7f1d66-a1ef-4e78-9d25-a29cb3b0355e tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.761s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:30 user nova-compute[75307]: INFO nova.compute.manager [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Terminating instance
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-0e816012-d454-45c8-81d1-20cebcfc1619 req-8931cc61-fe21-463f-9f5e-ef30e891c88c service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-unplugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Instance destroyed successfully.
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.objects.instance [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'resources' on Instance uuid 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:22:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1606590965',display_name='tempest-ServerActionsTestOtherA-server-1834134784',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1606590965',id=25,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJLJPdxsff+DyaczCAA373IurfdDDTNYMvgJ8tOVKRCN9JcHFKR3bKrj8m8SXxSpN93FXqYhIh3AE4YakDAcUSHw2kzQvCYmumhTfoZAzUq5PyyrJ5H1gjOErsXtxJyyg==',key_name='tempest-keypair-155296798',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:25:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-3tjvl3jt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=9b55c5d0-375b-4f93-a986-ac8cc4bf79d0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "address": "fa:16:3e:19:fa:e1", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcc168db1-3a", "ovs_interfaceid": "cc168db1-3a03-4452-bdd0-559e9e53e4d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG os_vif [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcc168db1-3a, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16f9241a-a76d-4303-ba02-094163416d18) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:30 user nova-compute[75307]: INFO os_vif [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:fa:e1,bridge_name='br-int',has_traffic_filtering=True,id=cc168db1-3a03-4452-bdd0-559e9e53e4d6,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcc168db1-3a')
Nov 13 23:28:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Deleting instance files /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0_del
Nov 13 23:28:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Deletion of /opt/stack/data/nova/instances/9b55c5d0-375b-4f93-a986-ac8cc4bf79d0_del complete
Nov 13 23:28:30 user nova-compute[75307]: INFO nova.compute.manager [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 23:28:30 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:28:30 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:28:31 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:31 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Took 0.69 seconds to deallocate network for instance.
Nov 13 23:28:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-7cc97c65-f0e4-42b8-8d5a-000334e6a737 req-eba1195d-e258-4709-a393-d933288e2a54 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-deleted-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:31 user nova-compute[75307]: INFO nova.compute.manager [req-7cc97c65-f0e4-42b8-8d5a-000334e6a737 req-eba1195d-e258-4709-a393-d933288e2a54 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Neutron deleted interface cc168db1-3a03-4452-bdd0-559e9e53e4d6; detaching it from the instance and deleting it from the info cache
Nov 13 23:28:31 user nova-compute[75307]: DEBUG nova.network.neutron [req-7cc97c65-f0e4-42b8-8d5a-000334e6a737 req-eba1195d-e258-4709-a393-d933288e2a54 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:28:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-7cc97c65-f0e4-42b8-8d5a-000334e6a737 req-eba1195d-e258-4709-a393-d933288e2a54 service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Detach interface failed, port_id=cc168db1-3a03-4452-bdd0-559e9e53e4d6, reason: Instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:28:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:32 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Deleted allocations for instance 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0
Nov 13 23:28:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-565deb45-907b-425b-b5e9-2cb811e0abd9 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.150s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] Acquiring lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] Lock "9b55c5d0-375b-4f93-a986-ac8cc4bf79d0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] No waiting events found dispatching network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:28:32 user nova-compute[75307]: WARNING nova.compute.manager [req-bdecde91-e4f3-4829-a265-532adaf9c2f0 req-43323896-3194-405b-b2bb-22b15f8b5e8e service nova] [instance: 9b55c5d0-375b-4f93-a986-ac8cc4bf79d0] Received unexpected event network-vif-plugged-cc168db1-3a03-4452-bdd0-559e9e53e4d6 for instance with vm_state deleted and task_state None.
Nov 13 23:28:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:37 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f6a7736a-5973-40cd-8e8e-0404353941c1 is timed out.
Nov 13 23:28:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully detached device vdb from instance f6a7736a-5973-40cd-8e8e-0404353941c1 from the live domain config.
Nov 13 23:28:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'trZNKEBF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:28:37 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48e2b24-8921-4de3-9787-61e4c00d4198]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:28:37 user nova-compute[75307]: No targets found.
Nov 13 23:28:37 user nova-compute[75307]: iSNS:
Nov 13 23:28:37 user nova-compute[75307]: No targets found.
Nov 13 23:28:37 user nova-compute[75307]: STATIC:
Nov 13 23:28:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981
Nov 13 23:28:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:28:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f
Nov 13 23:28:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:28:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:28:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:28:37 user nova-compute[75307]: FIRMWARE:
Nov 13 23:28:37 user nova-compute[75307]: No targets found.
Nov 13 23:28:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:28:37 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:28:37 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d0c9ad-39ec-487a-beff-03274a08691b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[733cf335-fbf6-47dd-8ebb-b17fc5fadebb]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:28:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:28:37 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:28:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34590940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f'): ({'sdf'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Removing single pathed devices sdf {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f697d4-8761-4ba4-9647-08a49438fdc1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8198951-7c3e-4855-864d-d890120289d7]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Flushing IO for device /dev/sdf {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53993884-3e49-415d-8e9a-b5960485254b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97d4446-226d-49bb-b0fb-98e82de5796e]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] SCSI volumes sdf have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:28:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e278764-123c-40d7-b3d9-79ead67ea7b0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[213ef007-5e8c-4a2f-9718-1b2361d23408]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260]
Nov 13 23:28:38 user nova-compute[75307]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f, portal: 172.16.0.220,3260] successful.
Nov 13 23:28:38 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c646ffa-1e24-4c18-bfd5-7065a4f5a42f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b09961-8d6a-4fbe-9440-ccd59512ce9f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] <== disconnect_volume: return (351ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:28:38 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:28:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'flavor' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:28:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3c5b29fe-8550-4a21-98e1-75bb912e582a tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.894s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:28:58 user nova-compute[75307]: INFO nova.compute.claims [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Claim successful on node user
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:28:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.policy [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1bf68aa47d54db7b01286e246e2e655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048088f95c114110be9def433f1fd534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:28:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Creating image(s)
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "/opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk 1073741824" returned: 0 in 0.051s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Cannot resize image /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Ensure instance console log exists: /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:28:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Successfully created port: df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Successfully updated port: df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquired lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-changed-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Refreshing instance network info cache due to event network-changed-df89b9a3-905a-49a7-9aca-dcdea83a9117. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] Acquiring lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating instance_info_cache with network_info: [{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Releasing lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Instance network_info: |[{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] Acquired lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Refreshing network info cache for port df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Start _get_guest_xml network_info=[{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:29:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:29:00 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-888115976',display_name='tempest-AttachVolumeNegativeTest-server-888115976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-888115976',id=34,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbL+KVeoSfxMcj07zCYiA6Lck+hUQw2K2O0rO1iNbI2ynYtZgv43Fr5AaXeR8kGual4fXcwYETkXVOryl7/x9WazBwNUZMDdvpeIOQre+wDXfBn7Oe2OKvcM6949kiDg==',key_name='tempest-keypair-726424116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-5k17edwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=02ac6279-f3bc-41df-89e0-493b7cdfa44e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'pci_devices' on Instance uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:29:00 user nova-compute[75307]:   <uuid>02ac6279-f3bc-41df-89e0-493b7cdfa44e</uuid>
Nov 13 23:29:00 user nova-compute[75307]:   <name>instance-00000022</name>
Nov 13 23:29:00 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:29:00 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:29:00 user nova-compute[75307]:   <metadata>
Nov 13 23:29:00 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:29:00 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeNegativeTest-server-888115976</nova:name>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:29:00</nova:creationTime>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:29:00 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:29:00 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:owner>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:user uuid="f1bf68aa47d54db7b01286e246e2e655">tempest-AttachVolumeNegativeTest-676261937-project-member</nova:user>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:project uuid="048088f95c114110be9def433f1fd534">tempest-AttachVolumeNegativeTest-676261937</nova:project>
Nov 13 23:29:00 user nova-compute[75307]:       </nova:owner>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:29:00 user nova-compute[75307]:       <nova:ports>
Nov 13 23:29:00 user nova-compute[75307]:         <nova:port uuid="df89b9a3-905a-49a7-9aca-dcdea83a9117">
Nov 13 23:29:00 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 23:29:00 user nova-compute[75307]:         </nova:port>
Nov 13 23:29:00 user nova-compute[75307]:       </nova:ports>
Nov 13 23:29:00 user nova-compute[75307]:     </nova:instance>
Nov 13 23:29:00 user nova-compute[75307]:   </metadata>
Nov 13 23:29:00 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:29:00 user nova-compute[75307]:     <system>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="serial">02ac6279-f3bc-41df-89e0-493b7cdfa44e</entry>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="uuid">02ac6279-f3bc-41df-89e0-493b7cdfa44e</entry>
Nov 13 23:29:00 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:29:00 user nova-compute[75307]:     </system>
Nov 13 23:29:00 user nova-compute[75307]:   </sysinfo>
Nov 13 23:29:00 user nova-compute[75307]:   <os>
Nov 13 23:29:00 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:29:00 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:29:00 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:29:00 user nova-compute[75307]:   </os>
Nov 13 23:29:00 user nova-compute[75307]:   <features>
Nov 13 23:29:00 user nova-compute[75307]:     <acpi/>
Nov 13 23:29:00 user nova-compute[75307]:     <apic/>
Nov 13 23:29:00 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:29:00 user nova-compute[75307]:   </features>
Nov 13 23:29:00 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:29:00 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:29:00 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:29:00 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:29:00 user nova-compute[75307]:   </clock>
Nov 13 23:29:00 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:29:00 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:29:00 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:29:00 user nova-compute[75307]:   </cpu>
Nov 13 23:29:00 user nova-compute[75307]:   <devices>
Nov 13 23:29:00 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:29:00 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:29:00 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk"/>
Nov 13 23:29:00 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:29:00 user nova-compute[75307]:     </disk>
Nov 13 23:29:00 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:29:00 user nova-compute[75307]:       <mac address="fa:16:3e:84:3c:96"/>
Nov 13 23:29:00 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:29:00 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:29:00 user nova-compute[75307]:       <target dev="tapdf89b9a3-90"/>
Nov 13 23:29:00 user nova-compute[75307]:     </interface>
Nov 13 23:29:00 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:29:00 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/console.log" append="off"/>
Nov 13 23:29:00 user nova-compute[75307]:     </serial>
Nov 13 23:29:00 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:29:00 user nova-compute[75307]:     <video>
Nov 13 23:29:00 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:29:00 user nova-compute[75307]:     </video>
Nov 13 23:29:00 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:29:00 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:29:00 user nova-compute[75307]:     </rng>
Nov 13 23:29:00 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:29:00 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:29:00 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:29:00 user nova-compute[75307]:     </memballoon>
Nov 13 23:29:00 user nova-compute[75307]:   </devices>
Nov 13 23:29:00 user nova-compute[75307]: </domain>
Nov 13 23:29:00 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-888115976',display_name='tempest-AttachVolumeNegativeTest-server-888115976',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-888115976',id=34,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbL+KVeoSfxMcj07zCYiA6Lck+hUQw2K2O0rO1iNbI2ynYtZgv43Fr5AaXeR8kGual4fXcwYETkXVOryl7/x9WazBwNUZMDdvpeIOQre+wDXfBn7Oe2OKvcM6949kiDg==',key_name='tempest-keypair-726424116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-5k17edwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:28:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=02ac6279-f3bc-41df-89e0-493b7cdfa44e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG os_vif [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e473b50d-66ca-5156-869a-96098455f859', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf89b9a3-90, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf89b9a3-90, col_values=(('qos', UUID('9fa08c9a-42d7-4aaf-b809-ca73658a21a7')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf89b9a3-90, col_values=(('external_ids', {'iface-id': 'df89b9a3-905a-49a7-9aca-dcdea83a9117', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:84:3c:96', 'vm-uuid': '02ac6279-f3bc-41df-89e0-493b7cdfa44e'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:00 user nova-compute[75307]: INFO os_vif [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90')
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:84:3c:96, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updated VIF entry in instance network info cache for port df89b9a3-905a-49a7-9aca-dcdea83a9117. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG nova.network.neutron [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating instance_info_cache with network_info: [{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a3ee48c2-d402-4fcc-be5e-a9ec728b1f9a req-82775e0b-061c-475d-a9ff-1f9bf42306eb service nova] Releasing lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] No waiting events found dispatching network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:02 user nova-compute[75307]: WARNING nova.compute.manager [req-2293cda2-08da-4c20-9e3d-c9107cf16c17 req-5d36637f-84e2-463a-b3c0-d95a33aae504 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received unexpected event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 for instance with vm_state building and task_state spawning.
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:29:04 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Instance spawned successfully.
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:29:04 user nova-compute[75307]: INFO nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Took 5.49 seconds to spawn the instance on the hypervisor.
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:29:04 user nova-compute[75307]: INFO nova.compute.manager [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Took 6.24 seconds to build instance.
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] No waiting events found dispatching network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:04 user nova-compute[75307]: WARNING nova.compute.manager [req-98699491-812a-4628-9422-49301c901e8c req-2173d1e1-4fed-442d-9d19-4cc600963460 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received unexpected event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 for instance with vm_state active and task_state None.
Nov 13 23:29:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e01f0a66-8269-48f3-83a6-761bf0c9f550 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.338s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:07 user nova-compute[75307]: INFO nova.compute.manager [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Terminating instance
Nov 13 23:29:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-80fb9575-281e-40cc-9c6f-e169527b0784 req-cf489c9d-953b-493d-ba25-168dbb897b82 service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-unplugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Instance destroyed successfully.
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid f6a7736a-5973-40cd-8e8e-0404353941c1 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-551549900',display_name='tempest-ServerRescueNegativeTestJSON-server-551549900',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-551549900',id=24,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAtqBJtxyMkvcPp7JlAXa+kLS85YNSUkgLrctZnBQ6Ae9TSu8Y6PKws/M+1yXgAOiQdEvLI7C+Q9wLe76rK2SBB/ciJtsrcKfxWhf3vhVPgV+FCvuOtSNQKPU7FgwsQIA==',key_name='tempest-keypair-602851905',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:24:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-la018wet',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:26:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=f6a7736a-5973-40cd-8e8e-0404353941c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "address": "fa:16:3e:f8:75:21", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ceb2d7f-b1", "ovs_interfaceid": "4ceb2d7f-b19c-4adc-b4e4-98aed704f613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG os_vif [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ceb2d7f-b1, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=adc48a2f-edc5-4b19-a03a-749f45d90dc7) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:08 user nova-compute[75307]: INFO os_vif [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:75:21,bridge_name='br-int',has_traffic_filtering=True,id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ceb2d7f-b1')
Nov 13 23:29:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Deleting instance files /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1_del
Nov 13 23:29:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Deletion of /opt/stack/data/nova/instances/f6a7736a-5973-40cd-8e8e-0404353941c1_del complete
Nov 13 23:29:08 user nova-compute[75307]: INFO nova.compute.manager [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 13 23:29:08 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:29:08 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:09 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Took 0.77 seconds to deallocate network for instance.
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-d4be69b1-0f9e-4512-96b1-0fddb896fd1e req-802bcfb5-c1c3-4d7f-aaa8-a3e3ffb5491f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-deleted-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:09 user nova-compute[75307]: INFO nova.compute.manager [req-d4be69b1-0f9e-4512-96b1-0fddb896fd1e req-802bcfb5-c1c3-4d7f-aaa8-a3e3ffb5491f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Neutron deleted interface 4ceb2d7f-b19c-4adc-b4e4-98aed704f613; detaching it from the instance and deleting it from the info cache
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-d4be69b1-0f9e-4512-96b1-0fddb896fd1e req-802bcfb5-c1c3-4d7f-aaa8-a3e3ffb5491f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-d4be69b1-0f9e-4512-96b1-0fddb896fd1e req-802bcfb5-c1c3-4d7f-aaa8-a3e3ffb5491f service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Detach interface failed, port_id=4ceb2d7f-b19c-4adc-b4e4-98aed704f613, reason: Instance f6a7736a-5973-40cd-8e8e-0404353941c1 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:29:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.390s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:09 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Deleted allocations for instance f6a7736a-5973-40cd-8e8e-0404353941c1
Nov 13 23:29:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-cbafef9b-1137-456f-9493-eb04859850b6 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.282s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] Acquiring lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] Lock "f6a7736a-5973-40cd-8e8e-0404353941c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] No waiting events found dispatching network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:10 user nova-compute[75307]: WARNING nova.compute.manager [req-23ae9bc9-cd4a-4540-8adc-ed15b303f0b9 req-0162af6b-66e9-4c9b-94fd-590791b93d1e service nova] [instance: f6a7736a-5973-40cd-8e8e-0404353941c1] Received unexpected event network-vif-plugged-4ceb2d7f-b19c-4adc-b4e4-98aed704f613 for instance with vm_state deleted and task_state None.
Nov 13 23:29:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:29:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:29:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:29:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:29:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:29:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing instance network info cache due to event network-changed-7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] Acquiring lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] Acquired lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Refreshing network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:18 user nova-compute[75307]: INFO nova.compute.manager [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Terminating instance
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-unplugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] No waiting events found dispatching network-vif-unplugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-63ed052e-3c5a-4dcb-9262-091a911b30dc req-8866abf9-fdb6-4434-a16b-2dafeff0edbe service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-unplugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updated VIF entry in instance network info cache for port 7a6461d6-ca33-4f59-81d5-4068de92f6c8. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating instance_info_cache with network_info: [{"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5179cf39-d978-4b35-b27e-ba9816af4b3c req-ec585b14-26e7-4de2-97a9-6d7ca46057bc service nova] Releasing lock "refresh_cache-f6233ac6-5054-48b9-94cf-607e2b2b28e9" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Instance destroyed successfully.
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.objects.instance [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lazy-loading 'resources' on Instance uuid f6233ac6-5054-48b9-94cf-607e2b2b28e9 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:29:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:29:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=7613MB free_disk=25.208782196044922GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:22:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-311642129',display_name='tempest-TestStampPattern-server-311642129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-311642129',id=23,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCWQhP5g1buJ3cScnJcB+1Tuha39dmgMfyf/zrB5NX1ZEJLplbAABX2Ln6pEF5fYHLtfhc+FKLsFepOnu93IVy07GM8+H1BlClze1P5Xgy4py9AnM+qGnRI2P8bpRut8fw==',key_name='tempest-TestStampPattern-667353749',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:22:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb',ramdisk_id='',reservation_id='r-p8sz8sjw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1908061242',owner_user_name='tempest-TestStampPattern-1908061242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:25:31Z,user_data=None,user_id='519cf74c92b9446a9c644f45f3909253',uuid=f6233ac6-5054-48b9-94cf-607e2b2b28e9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converting VIF {"id": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "address": "fa:16:3e:a6:57:36", "network": {"id": "ba64dd95-33a9-407b-acbf-b8b5ffbc8768", "bridge": "br-int", "label": "tempest-TestStampPattern-1964115168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3c4c1fcdfdfa4eb0b5cbae95b1c3cbeb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a6461d6-ca", "ovs_interfaceid": "7a6461d6-ca33-4f59-81d5-4068de92f6c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG os_vif [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a6461d6-ca, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=103f71c4-342a-47f5-a74a-07f5f7a4ec95) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:19 user nova-compute[75307]: INFO os_vif [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:57:36,bridge_name='br-int',has_traffic_filtering=True,id=7a6461d6-ca33-4f59-81d5-4068de92f6c8,network=Network(ba64dd95-33a9-407b-acbf-b8b5ffbc8768),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a6461d6-ca')
Nov 13 23:29:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Deleting instance files /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9_del
Nov 13 23:29:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Deletion of /opt/stack/data/nova/instances/f6233ac6-5054-48b9-94cf-607e2b2b28e9_del complete
Nov 13 23:29:19 user nova-compute[75307]: INFO nova.compute.manager [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f6233ac6-5054-48b9-94cf-607e2b2b28e9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 25c8b300-4c7b-4370-b014-41b0085dc217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a90dad03-c454-4728-a5a6-cf5759a41ed7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance fc0198dc-a30f-4172-810e-0b8b2e10a110 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:19 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Took 0.43 seconds to deallocate network for instance.
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:20 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Deleted allocations for instance f6233ac6-5054-48b9-94cf-607e2b2b28e9
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df15ea95-35ff-43fd-86b4-295a4fb0ddc5 tempest-TestStampPattern-1908061242 tempest-TestStampPattern-1908061242-project-member] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.131s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] Acquiring lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] Lock "f6233ac6-5054-48b9-94cf-607e2b2b28e9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] No waiting events found dispatching network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:20 user nova-compute[75307]: WARNING nova.compute.manager [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received unexpected event network-vif-plugged-7a6461d6-ca33-4f59-81d5-4068de92f6c8 for instance with vm_state deleted and task_state None.
Nov 13 23:29:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-594bdd54-1a09-4e3e-b5ef-854202097312 req-a0c9f0be-432c-4831-b12e-5483f4c60653 service nova] [instance: f6233ac6-5054-48b9-94cf-607e2b2b28e9] Received event network-vif-deleted-7a6461d6-ca33-4f59-81d5-4068de92f6c8 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:29:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:50 user nova-compute[75307]: INFO nova.compute.manager [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Terminating instance
Nov 13 23:29:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG nova.compute.manager [req-0b7d0a62-1113-4cef-aef0-61de3c4211dc req-be2fbf0e-81e8-4ea1-adc4-1a9460e05bd1 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-unplugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:29:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Instance destroyed successfully.
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lazy-loading 'resources' on Instance uuid a90dad03-c454-4728-a5a6-cf5759a41ed7 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:21:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-619339730',display_name='tempest-ServerActionsTestOtherB-server-619339730',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-619339730',id=22,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCh3beYk3yGe30WY1JjlRZvKBfMkTCgjCb37EmlzJ3J+sbGlVZZ41dNgtQptQjDlzHmU0XNQ80dXZWYmi9k+MH1ND8za0xMiRi/FI9jVVa39GMDpppaG9CZKNggEmZSiiQ==',key_name='tempest-keypair-1662994228',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:27:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9031887798954fab9ea96c7ce9c30984',ramdisk_id='',reservation_id='r-y6t4ekhb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-391883818',owner_user_name='tempest-ServerActionsTestOtherB-391883818-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:27:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='025c402ce1bc4de7a718a2b5e119b4ae',uuid=a90dad03-c454-4728-a5a6-cf5759a41ed7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converting VIF {"id": "47e669d9-2897-4d52-8611-36afbf74c293", "address": "fa:16:3e:0a:ba:fe", "network": {"id": "e0366ea4-38ff-4e3e-9001-6b6a458ba8dc", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-868270830-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9031887798954fab9ea96c7ce9c30984", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47e669d9-28", "ovs_interfaceid": "47e669d9-2897-4d52-8611-36afbf74c293", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_vif [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47e669d9-28, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c0048df7-9d55-471e-8fb2-754f8a306f90) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:29:51 user nova-compute[75307]: INFO os_vif [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:ba:fe,bridge_name='br-int',has_traffic_filtering=True,id=47e669d9-2897-4d52-8611-36afbf74c293,network=Network(e0366ea4-38ff-4e3e-9001-6b6a458ba8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47e669d9-28')
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrhcmVOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:29:51 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd504c0-4816-4433-a813-177d58b9a066]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:29:51 user nova-compute[75307]: No targets found.
Nov 13 23:29:51 user nova-compute[75307]: iSNS:
Nov 13 23:29:51 user nova-compute[75307]: No targets found.
Nov 13 23:29:51 user nova-compute[75307]: STATIC:
Nov 13 23:29:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981
Nov 13 23:29:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:29:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:29:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea
Nov 13 23:29:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:29:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:29:51 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:29:51 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:29:51 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:29:51 user nova-compute[75307]: FIRMWARE:
Nov 13 23:29:51 user nova-compute[75307]: No targets found.
Nov 13 23:29:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:29:51 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:29:51 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194ba8b-ee69-41f9-bd5e-11c05254c49a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b038b7ba-3528-4f19-8e59-23681a2dc3a0]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:29:51 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:29:51 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:29:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:29:51 user nova-compute[75307]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea (non-flash)
Nov 13 23:29:51 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:29:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34294160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5954ee36-398c-41a7-b153-98656646ee02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6e42b-0b77-40f2-b0d8-50790bfbae63]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[641cddcc-3587-4aa9-9ea6-05be6899d9ea]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[276d9ff1-be33-465b-9b7a-b80442c665d1]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76f4747-41e6-44df-9078-30dae795a046]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1060fa8e-9912-4369-a8a8-948e68120011]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260]
Nov 13 23:29:51 user nova-compute[75307]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea, portal: 172.16.0.220,3260] successful.
Nov 13 23:29:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:634bc8fe-fec1-430f-8083-7721767f4bea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4b7b9d-647e-4c5c-968d-e923c9469dd4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] <== disconnect_volume: return (341ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:29:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Deleting instance files /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_del
Nov 13 23:29:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Deletion of /opt/stack/data/nova/instances/a90dad03-c454-4728-a5a6-cf5759a41ed7_del complete
Nov 13 23:29:51 user nova-compute[75307]: INFO nova.compute.manager [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 13 23:29:51 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:29:51 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:29:52 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:29:52 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Took 0.66 seconds to deallocate network for instance.
Nov 13 23:29:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] Acquiring lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] No waiting events found dispatching network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:29:52 user nova-compute[75307]: WARNING nova.compute.manager [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received unexpected event network-vif-plugged-47e669d9-2897-4d52-8611-36afbf74c293 for instance with vm_state active and task_state deleting.
Nov 13 23:29:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-d9a42504-54f0-41aa-99c4-a39f317ec848 req-31417bc1-874f-4dc7-9ab8-c7d10a41b555 service nova] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Received event network-vif-deleted-47e669d9-2897-4d52-8611-36afbf74c293 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:29:53 user nova-compute[75307]: INFO nova.compute.manager [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] [instance: a90dad03-c454-4728-a5a6-cf5759a41ed7] Took 0.81 seconds to detach 1 volumes for instance.
Nov 13 23:29:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:29:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:29:53 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:29:53 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:29:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:53 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Deleted allocations for instance a90dad03-c454-4728-a5a6-cf5759a41ed7
Nov 13 23:29:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a338ad25-3ec5-481e-868f-5d226b9b41b3 tempest-ServerActionsTestOtherB-391883818 tempest-ServerActionsTestOtherB-391883818-project-member] Lock "a90dad03-c454-4728-a5a6-cf5759a41ed7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.198s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:29:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:03 user nova-compute[75307]: INFO nova.compute.manager [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Terminating instance
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-df2aad1d-6028-4085-8ce6-16096f3a4ea7 req-048e1768-7ae8-4884-a844-86214727e2b7 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-unplugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Instance destroyed successfully.
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-540814245',display_name='tempest-ServerRescueNegativeTestJSON-server-540814245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-540814245',id=3,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-zop0x8wy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:16:02Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=7ce8bbfc-ee12-48b0-85a4-8c7680502e6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "address": "fa:16:3e:f1:e9:5a", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7b19d21-b8", "ovs_interfaceid": "e7b19d21-b8a1-40c4-a576-1ac4f4276c4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG os_vif [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7b19d21-b8, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b98a77ce-5607-4c25-9646-2f960b6fdf1a) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:03 user nova-compute[75307]: INFO os_vif [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f1:e9:5a,bridge_name='br-int',has_traffic_filtering=True,id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7b19d21-b8')
Nov 13 23:30:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Deleting instance files /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d_del
Nov 13 23:30:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Deletion of /opt/stack/data/nova/instances/7ce8bbfc-ee12-48b0-85a4-8c7680502e6d_del complete
Nov 13 23:30:03 user nova-compute[75307]: INFO nova.compute.manager [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Took 0.69 seconds to destroy the instance on the hypervisor.
Nov 13 23:30:03 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:30:03 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:04 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Took 0.43 seconds to deallocate network for instance.
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-ce7c2201-6adb-4d93-9e83-986f6fb27b6c req-9c9c9f3b-0ddd-4929-a4c2-d258c3980537 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-deleted-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:04 user nova-compute[75307]: INFO nova.compute.manager [req-ce7c2201-6adb-4d93-9e83-986f6fb27b6c req-9c9c9f3b-0ddd-4929-a4c2-d258c3980537 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Neutron deleted interface e7b19d21-b8a1-40c4-a576-1ac4f4276c4d; detaching it from the instance and deleting it from the info cache
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-ce7c2201-6adb-4d93-9e83-986f6fb27b6c req-9c9c9f3b-0ddd-4929-a4c2-d258c3980537 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-ce7c2201-6adb-4d93-9e83-986f6fb27b6c req-9c9c9f3b-0ddd-4929-a4c2-d258c3980537 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Detach interface failed, port_id=e7b19d21-b8a1-40c4-a576-1ac4f4276c4d, reason: Instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.280s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:04 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Deleted allocations for instance 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d
Nov 13 23:30:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6024f68b-1bb1-4a24-af65-f382e1909040 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.659s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] Acquiring lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] Lock "7ce8bbfc-ee12-48b0-85a4-8c7680502e6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] No waiting events found dispatching network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:05 user nova-compute[75307]: WARNING nova.compute.manager [req-99421c4c-0f36-4293-a4d9-35dfc1200003 req-79688f4c-1f68-4a53-bc81-b3b83949bb42 service nova] [instance: 7ce8bbfc-ee12-48b0-85a4-8c7680502e6d] Received unexpected event network-vif-plugged-e7b19d21-b8a1-40c4-a576-1ac4f4276c4d for instance with vm_state deleted and task_state None.
Nov 13 23:30:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:06 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:06 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:30:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:08 user nova-compute[75307]: INFO nova.compute.manager [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Terminating instance
Nov 13 23:30:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-unplugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] No waiting events found dispatching network-vif-unplugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9c9ebca-a7de-4b7a-aa8b-f02ac5b7550e req-fc8a89c0-0df4-472f-8180-5a922e0b6ca1 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-unplugged-d586ea61-4f5f-4d79-8555-a93b59472857 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Instance destroyed successfully.
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lazy-loading 'resources' on Instance uuid 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1169228286',display_name='tempest-ServersNegativeTestJSON-server-1169228286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1169228286',id=33,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:28:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-za8d7jhc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:28:26Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=0b28d902-aa7f-4da7-a8e2-68b02eeadfe2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "d586ea61-4f5f-4d79-8555-a93b59472857", "address": "fa:16:3e:c0:ee:8b", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd586ea61-4f", "ovs_interfaceid": "d586ea61-4f5f-4d79-8555-a93b59472857", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG os_vif [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd586ea61-4f, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=003ac1f9-cde1-4533-a567-43c42e096966) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:09 user nova-compute[75307]: INFO os_vif [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:ee:8b,bridge_name='br-int',has_traffic_filtering=True,id=d586ea61-4f5f-4d79-8555-a93b59472857,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd586ea61-4f')
Nov 13 23:30:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Deleting instance files /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2_del
Nov 13 23:30:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Deletion of /opt/stack/data/nova/instances/0b28d902-aa7f-4da7-a8e2-68b02eeadfe2_del complete
Nov 13 23:30:09 user nova-compute[75307]: INFO nova.compute.manager [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 13 23:30:09 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing instance network info cache due to event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] Acquiring lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] Acquired lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:09 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Took 0.66 seconds to deallocate network for instance.
Nov 13 23:30:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-115e5ab2-8d13-498d-8931-fa61635be01d req-bd4d5189-e78a-4069-9445-8fdf3108b08e service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-deleted-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:10 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Deleted allocations for instance 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0c130cfc-d5af-4f75-bdd9-f62080423a96 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.028s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updated VIF entry in instance network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.network.neutron [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating instance_info_cache with network_info: [{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f2f620f0-ddd1-4d3a-a870-977581a30436 req-c45c414c-00e5-4c76-b63c-236fb0d2b398 service nova] Releasing lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] Acquiring lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] Lock "0b28d902-aa7f-4da7-a8e2-68b02eeadfe2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] No waiting events found dispatching network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:10 user nova-compute[75307]: WARNING nova.compute.manager [req-73dbd9e3-094f-4a76-b350-0caefe97e031 req-e433c902-6744-4149-baa1-f4200c318704 service nova] [instance: 0b28d902-aa7f-4da7-a8e2-68b02eeadfe2] Received unexpected event network-vif-plugged-d586ea61-4f5f-4d79-8555-a93b59472857 for instance with vm_state deleted and task_state None.
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:10 user nova-compute[75307]: INFO nova.compute.manager [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Terminating instance
Nov 13 23:30:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Instance destroyed successfully.
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid fc0198dc-a30f-4172-810e-0b8b2e10a110 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-335464581',display_name='tempest-TestVolumeBootPattern-server-335464581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-335464581',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:28:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-4k0iag31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:28:28Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=fc0198dc-a30f-4172-810e-0b8b2e10a110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_vif [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ee1c324-87, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2acca64-9d91-40bc-aaa2-0f35d38bdb6a) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:11 user nova-compute[75307]: INFO os_vif [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:6c:d0,bridge_name='br-int',has_traffic_filtering=True,id=4ee1c324-878e-42e7-bd3a-e7484defdb32,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ee1c324-87')
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YiENqlTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:30:11 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b4e9d7-43c1-4adf-9874-30a916c02de0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:30:11 user nova-compute[75307]: No targets found.
Nov 13 23:30:11 user nova-compute[75307]: iSNS:
Nov 13 23:30:11 user nova-compute[75307]: No targets found.
Nov 13 23:30:11 user nova-compute[75307]: STATIC:
Nov 13 23:30:11 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981
Nov 13 23:30:11 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:30:11 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:30:11 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:30:11 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:30:11 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:30:11 user nova-compute[75307]: FIRMWARE:
Nov 13 23:30:11 user nova-compute[75307]: No targets found.
Nov 13 23:30:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:30:11 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:30:11 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d32f4f-3e30-4e7c-8b36-23948421af47]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[407994af-bc9d-47a1-a370-caf28528e041]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:11 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:30:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:11 user nova-compute[75307]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 (non-flash)
Nov 13 23:30:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c2cfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[306915a3-6b69-451a-b73b-6f08dc0e84da]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c874c496-fb84-4445-809c-56b517256a1c]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3185d56-33ce-4293-bf09-9af5ddd930da]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00b0952-e160-4389-88ea-de96c9b6a897]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b8361085', '/dev/disk/by-id/scsi-26263613730646531', '/dev/disk/by-id/scsi-1SCST_BIOb8361085-bca70de10c832e7c') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c07c55c-9b2f-4c89-9347-0e9866bd01a9]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3fb04c-a2a7-424f-a9ae-1d3b37509a33]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee602300-10f4-42aa-a45c-1a5f371f8730]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260]
Nov 13 23:30:11 user nova-compute[75307]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981, portal: 172.16.0.220,3260] successful.
Nov 13 23:30:11 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6dfe4c3e-2611-4538-8d8e-d6f9aa936981 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[05460dbf-0302-408c-bb11-f066740fa7a9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (312ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:30:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:30:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Deleting instance files /opt/stack/data/nova/instances/fc0198dc-a30f-4172-810e-0b8b2e10a110_del
Nov 13 23:30:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Deletion of /opt/stack/data/nova/instances/fc0198dc-a30f-4172-810e-0b8b2e10a110_del complete
Nov 13 23:30:12 user nova-compute[75307]: INFO nova.compute.manager [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing instance network info cache due to event network-changed-4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] Acquiring lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] Acquired lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Refreshing network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updated VIF entry in instance network info cache for port 4ee1c324-878e-42e7-bd3a-e7484defdb32. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating instance_info_cache with network_info: [{"id": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "address": "fa:16:3e:2f:6c:d0", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ee1c324-87", "ovs_interfaceid": "4ee1c324-878e-42e7-bd3a-e7484defdb32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a9157b6-5dcb-42b4-8251-53e6f03a5d4f req-40b7c664-6217-4c60-900e-9c9537983742 service nova] Releasing lock "refresh_cache-fc0198dc-a30f-4172-810e-0b8b2e10a110" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:12 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Took 0.70 seconds to deallocate network for instance.
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-unplugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] No waiting events found dispatching network-vif-unplugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-unplugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Acquiring lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] No waiting events found dispatching network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:12 user nova-compute[75307]: WARNING nova.compute.manager [req-01cd98f0-8bcc-43d5-813b-e89d215eefed req-f9439917-ce14-49fe-b143-3cfabac13a5f service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received unexpected event network-vif-plugged-4ee1c324-878e-42e7-bd3a-e7484defdb32 for instance with vm_state active and task_state deleting.
Nov 13 23:30:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:13 user nova-compute[75307]: INFO nova.compute.manager [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Took 0.72 seconds to detach 1 volumes for instance.
Nov 13 23:30:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:13 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:13 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:13 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance fc0198dc-a30f-4172-810e-0b8b2e10a110
Nov 13 23:30:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fc0a9f91-14f7-4209-ba13-d482557cc64d tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "fc0198dc-a30f-4172-810e-0b8b2e10a110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.029s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-639c6ec1-4d37-4b92-a543-c989cb11e3fa req-0d173c32-a08a-41cf-88c8-441cf80ba5b8 service nova] [instance: fc0198dc-a30f-4172-810e-0b8b2e10a110] Received event network-vif-deleted-4ee1c324-878e-42e7-bd3a-e7484defdb32 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:30:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:30:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:18 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:18 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8280MB free_disk=25.38040542602539GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:30:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 11cd5b9d-7bb2-4492-8031-a9676c288140 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 25c8b300-4c7b-4370-b014-41b0085dc217 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:30:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.790s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:30:25 user nova-compute[75307]: INFO nova.compute.claims [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Claim successful on node user
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:30:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.policy [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7b605f62d134435896eb5dce0b48d51c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f4260b68885d4f5ebfa01306bf64a9b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:30:25 user nova-compute[75307]: INFO nova.virt.block_device [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Booting with volume fe89a298-e459-4821-b0fd-c5cfa0e4047a at /dev/vda
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33df6f8e-1f69-4bbe-97c8-2c68a074bf71]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53ec2ff-d3d7-480b-b285-f66c9f07351a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd12cc88-3ac3-4056-885d-1e0dc55b01ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[92543c1f-c274-4c12-bdcf-ac0dec04b7f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:30:25 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:30:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[65488f5d-d88a-4740-919d-bff4af30a8e7]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG os_brick.utils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:30:25 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating existing volume attachment record: 6d8bd5e6-7733-49a9-89e6-b7aaafd66be5 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Successfully created port: f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Successfully updated port: f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-changed-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Refreshing instance network info cache due to event network-changed-f3cb8024-52d1-42b1-81b5-1f5eee8e079c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:30:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance network_info: |[{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Refreshing network info cache for port f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updated VIF entry in instance network info cache for port f3cb8024-52d1-42b1-81b5-1f5eee8e079c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-200b60be-5f17-4bd4-af0b-d160fac22140 req-582e70a3-f41e-49e8-8672-fcfccb537898 service nova] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:30:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Creating image(s)
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Ensure instance console log exists: /opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start _get_guest_xml network_info=[{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4afb051a-6ad3-4d1b-b5f7-832ad997bd9c', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'serial': 'fe89a298-e459-4821-b0fd-c5cfa0e4047a'}, 'delete_on_termination': True, 'attachment_id': '6d8bd5e6-7733-49a9-89e6-b7aaafd66be5', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:30:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:30:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:30:30 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:30:30 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed563c6-617f-4423-924c-88b9854bd531]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:30:30 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d0fc19-4386-483e-87b9-59d0d198e316]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a] added
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5083bb2-4cf7-4015-b8e3-31b037a77ff6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1045433e-e253-4ad7-bde5-49f69f6f0d36]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TenGdtEF {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TenGdtEF" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db5533-d775-4aac-8a9c-e1aefae0e480]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TenGdtEF'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b6e5de-ab98-4985-8d0c-6978996581e4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[102e2f38-625d-478d-b02d-d6dd46a948b3]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc27aa6-19ba-4bea-bf62-5f6266c36f66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]
Nov 13 23:30:30 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[166871da-5f5f-4845-a827-6ba507f8fcb8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2934bc06-cd21-43eb-b564-efb99dd8bfb1]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:30 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:30 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:30 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179293a-df24-4e65-b626-e5d6046e58b2]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:30:30 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26637613335386163', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613335386163', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'pci_devices' on Instance uuid 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:30:31 user nova-compute[75307]:   <uuid>4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</uuid>
Nov 13 23:30:31 user nova-compute[75307]:   <name>instance-00000023</name>
Nov 13 23:30:31 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:30:31 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:30:31 user nova-compute[75307]:   <metadata>
Nov 13 23:30:31 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:30:31 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:30:31 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherA-server-1777366366</nova:name>
Nov 13 23:30:31 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:30:30</nova:creationTime>
Nov 13 23:30:31 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:30:31 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:30:31 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:30:31 user nova-compute[75307]:       <nova:owner>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:user uuid="7b605f62d134435896eb5dce0b48d51c">tempest-ServerActionsTestOtherA-708902499-project-member</nova:user>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:project uuid="f4260b68885d4f5ebfa01306bf64a9b9">tempest-ServerActionsTestOtherA-708902499</nova:project>
Nov 13 23:30:31 user nova-compute[75307]:       </nova:owner>
Nov 13 23:30:31 user nova-compute[75307]:       <nova:ports>
Nov 13 23:30:31 user nova-compute[75307]:         <nova:port uuid="f3cb8024-52d1-42b1-81b5-1f5eee8e079c">
Nov 13 23:30:31 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:30:31 user nova-compute[75307]:         </nova:port>
Nov 13 23:30:31 user nova-compute[75307]:       </nova:ports>
Nov 13 23:30:31 user nova-compute[75307]:     </nova:instance>
Nov 13 23:30:31 user nova-compute[75307]:   </metadata>
Nov 13 23:30:31 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:30:31 user nova-compute[75307]:     <system>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="serial">4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</entry>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="uuid">4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</entry>
Nov 13 23:30:31 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:30:31 user nova-compute[75307]:     </system>
Nov 13 23:30:31 user nova-compute[75307]:   </sysinfo>
Nov 13 23:30:31 user nova-compute[75307]:   <os>
Nov 13 23:30:31 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:30:31 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:30:31 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:30:31 user nova-compute[75307]:   </os>
Nov 13 23:30:31 user nova-compute[75307]:   <features>
Nov 13 23:30:31 user nova-compute[75307]:     <acpi/>
Nov 13 23:30:31 user nova-compute[75307]:     <apic/>
Nov 13 23:30:31 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:30:31 user nova-compute[75307]:   </features>
Nov 13 23:30:31 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:30:31 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:30:31 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:30:31 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:30:31 user nova-compute[75307]:   </clock>
Nov 13 23:30:31 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:30:31 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:30:31 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:30:31 user nova-compute[75307]:   </cpu>
Nov 13 23:30:31 user nova-compute[75307]:   <devices>
Nov 13 23:30:31 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:30:31 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:30:31 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:30:31 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:30:31 user nova-compute[75307]:       <serial>fe89a298-e459-4821-b0fd-c5cfa0e4047a</serial>
Nov 13 23:30:31 user nova-compute[75307]:     </disk>
Nov 13 23:30:31 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:30:31 user nova-compute[75307]:       <mac address="fa:16:3e:91:44:9a"/>
Nov 13 23:30:31 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:30:31 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:30:31 user nova-compute[75307]:       <target dev="tapf3cb8024-52"/>
Nov 13 23:30:31 user nova-compute[75307]:     </interface>
Nov 13 23:30:31 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:30:31 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c/console.log" append="off"/>
Nov 13 23:30:31 user nova-compute[75307]:     </serial>
Nov 13 23:30:31 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:30:31 user nova-compute[75307]:     <video>
Nov 13 23:30:31 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:30:31 user nova-compute[75307]:     </video>
Nov 13 23:30:31 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:30:31 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:30:31 user nova-compute[75307]:     </rng>
Nov 13 23:30:31 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:30:31 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:30:31 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:30:31 user nova-compute[75307]:     </memballoon>
Nov 13 23:30:31 user nova-compute[75307]:   </devices>
Nov 13 23:30:31 user nova-compute[75307]: </domain>
Nov 13 23:30:31 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:30:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG os_vif [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25125510-2a1a-5736-a7d0-00f61421b197', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3cb8024-52, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3cb8024-52, col_values=(('qos', UUID('2072b705-2123-4177-9d88-9a00115c0b8c')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3cb8024-52, col_values=(('external_ids', {'iface-id': 'f3cb8024-52d1-42b1-81b5-1f5eee8e079c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:44:9a', 'vm-uuid': '4afb051a-6ad3-4d1b-b5f7-832ad997bd9c'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:31 user nova-compute[75307]: INFO os_vif [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52')
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:30:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:91:44:9a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:33 user nova-compute[75307]: WARNING nova.compute.manager [req-519bc1c6-a334-4402-a7f3-b0217531e330 req-6029a041-91d4-4598-81c8-b5bf6bdde426 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state building and task_state spawning.
Nov 13 23:30:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:30:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance spawned successfully.
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:30:35 user nova-compute[75307]: INFO nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:35 user nova-compute[75307]: WARNING nova.compute.manager [req-697239f5-30c8-4a35-bdf5-23468bd7badd req-060b1e80-4040-4c60-8de4-1745837ba008 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state building and task_state spawning.
Nov 13 23:30:35 user nova-compute[75307]: INFO nova.compute.manager [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Took 10.14 seconds to build instance.
Nov 13 23:30:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1cbd5dd0-f1f2-4388-8b89-8e50d014c521 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.241s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-changed-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Refreshing instance network info cache due to event network-changed-df89b9a3-905a-49a7-9aca-dcdea83a9117. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] Acquiring lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] Acquired lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Refreshing network info cache for port df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updated VIF entry in instance network info cache for port df89b9a3-905a-49a7-9aca-dcdea83a9117. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating instance_info_cache with network_info: [{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3db34343-52e8-43ae-b5b8-2b836bafc288 req-e9c8da83-a854-4b0c-9a61-c294ce2c73f4 service nova] Releasing lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:50 user nova-compute[75307]: INFO nova.compute.manager [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Attaching volume b7079823-4b44-4246-8353-803bf0966469 to /dev/vdb
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.utils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b46062-a054-47c3-89d5-dd4b075f8c7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8789a77b-f9e5-42fd-a9ab-9f311bd232db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[949e3e0c-ae81-4133-8297-9ac66274c881]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dab963-5699-4091-9955-e9e6066bc207]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:30:51 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:30:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9018f4ca-446d-48a7-ab7c-5c182080ef24]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG os_brick.utils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating existing volume attachment record: 5aabf2b0-ff92-4747-ac94-5e78673dd038 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:53 user nova-compute[75307]: INFO nova.compute.manager [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Terminating instance
Nov 13 23:30:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Instance destroyed successfully.
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.objects.instance [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lazy-loading 'resources' on Instance uuid 11cd5b9d-7bb2-4492-8031-a9676c288140 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:14:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1658784171',display_name='tempest-ServerRescueNegativeTestJSON-server-1658784171',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1658784171',id=2,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:18:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7260b3ec00fc412091e6db3c55993345',ramdisk_id='',reservation_id='r-d1rywi5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1822128029',owner_user_name='tempest-ServerRescueNegativeTestJSON-1822128029-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:20:44Z,user_data=None,user_id='8ca0ce44f4d041b5b98883e3796abe32',uuid=11cd5b9d-7bb2-4492-8031-a9676c288140,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converting VIF {"id": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "address": "fa:16:3e:a9:6b:e6", "network": {"id": "0bc856bc-1925-402a-84e8-4184eb47739c", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-2116188037-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7260b3ec00fc412091e6db3c55993345", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap92e3832b-fb", "ovs_interfaceid": "92e3832b-fb83-4ed1-8a9a-bc575a008b87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG os_vif [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap92e3832b-fb, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e1d2a1e9-ce60-4a5c-8cd8-af4909b81a8d) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:54 user nova-compute[75307]: INFO os_vif [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:6b:e6,bridge_name='br-int',has_traffic_filtering=True,id=92e3832b-fb83-4ed1-8a9a-bc575a008b87,network=Network(0bc856bc-1925-402a-84e8-4184eb47739c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap92e3832b-fb')
Nov 13 23:30:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Deleting instance files /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140_del
Nov 13 23:30:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Deletion of /opt/stack/data/nova/instances/11cd5b9d-7bb2-4492-8031-a9676c288140_del complete
Nov 13 23:30:54 user nova-compute[75307]: INFO nova.compute.manager [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 13 23:30:54 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:30:54 user nova-compute[75307]: INFO nova.compute.claims [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Claim successful on node user
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:55 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Took 0.50 seconds to deallocate network for instance.
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-702fa086-1eb5-4240-9bd5-67eac4eadaaa req-bfb19fce-6807-46b0-8f50-65d8dd7f81f3 service nova] [instance: 11cd5b9d-7bb2-4492-8031-a9676c288140] Received event network-vif-deleted-92e3832b-fb83-4ed1-8a9a-bc575a008b87 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.351s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.133s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:30:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.policy [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049e1cfffeef4a1996a661e5a3894ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324dfec822e6496d9601b2198091aa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcBOzPVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:30:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:30:55 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:30:55 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[832a5800-2c88-4691-b468-035ba6f6f11f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:30:55 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e7b2d8-7c1b-46bc-a744-7abcbea16954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:30:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Creating image(s)
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "/opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469] added
Nov 13 23:30:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b843a7-4152-4595-85be-d4f3cd89675d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.608s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5915c-409b-4ba4-9f19-3f3d81b72e49]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcBOzPVJ {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Deleted allocations for instance 11cd5b9d-7bb2-4492-8031-a9676c288140
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lcBOzPVJ" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638902c-9954-4914-88b3-3f08b65345d0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lcBOzPVJ'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0215230b-2a18-44f0-91cc-965f36515442]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[549cf230-d5ca-4c5d-943b-663bfbb6b758]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Successfully created port: fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-23b01958-5055-4165-b42c-29034512ff11 tempest-ServerRescueNegativeTestJSON-1822128029 tempest-ServerRescueNegativeTestJSON-1822128029-project-member] Lock "11cd5b9d-7bb2-4492-8031-a9676c288140" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.113s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf61e983-729e-43d2-a55a-3fc854688f85]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260]
Nov 13 23:30:56 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260] successful.
Nov 13 23:30:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac9f88b-c0c4-47e1-bb65-1cba6bc16bff]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a647c508-45a6-4700-a4e6-2545fbc1c12f]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:30:56 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:30:56 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.656s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb70750-4066-427a-81b9-9a6e8adb9ca7]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcBOzPVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk 1073741824" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Successfully updated port: fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Cannot resize image /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Ensure instance console log exists: /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:30:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.neutron [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Instance network_info: |[{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Start _get_guest_xml network_info=[{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:30:57 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:57 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697303006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697303006',id=36,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-8qmv1pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:30:55Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f619c353-0802-4546-a6e3-4a9b1e89f084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-changed-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Refreshing instance network info cache due to event network-changed-fe50f192-d26e-4b53-b5e8-b428aed38da4. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.neutron [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Refreshing network info cache for port fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:30:57 user nova-compute[75307]:   <uuid>f619c353-0802-4546-a6e3-4a9b1e89f084</uuid>
Nov 13 23:30:57 user nova-compute[75307]:   <name>instance-00000024</name>
Nov 13 23:30:57 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:30:57 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:30:57 user nova-compute[75307]:   <metadata>
Nov 13 23:30:57 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:30:57 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-697303006</nova:name>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:30:57</nova:creationTime>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:30:57 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:30:57 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:owner>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:30:57 user nova-compute[75307]:       </nova:owner>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:30:57 user nova-compute[75307]:       <nova:ports>
Nov 13 23:30:57 user nova-compute[75307]:         <nova:port uuid="fe50f192-d26e-4b53-b5e8-b428aed38da4">
Nov 13 23:30:57 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:30:57 user nova-compute[75307]:         </nova:port>
Nov 13 23:30:57 user nova-compute[75307]:       </nova:ports>
Nov 13 23:30:57 user nova-compute[75307]:     </nova:instance>
Nov 13 23:30:57 user nova-compute[75307]:   </metadata>
Nov 13 23:30:57 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:30:57 user nova-compute[75307]:     <system>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="serial">f619c353-0802-4546-a6e3-4a9b1e89f084</entry>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="uuid">f619c353-0802-4546-a6e3-4a9b1e89f084</entry>
Nov 13 23:30:57 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:30:57 user nova-compute[75307]:     </system>
Nov 13 23:30:57 user nova-compute[75307]:   </sysinfo>
Nov 13 23:30:57 user nova-compute[75307]:   <os>
Nov 13 23:30:57 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:30:57 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:30:57 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:30:57 user nova-compute[75307]:   </os>
Nov 13 23:30:57 user nova-compute[75307]:   <features>
Nov 13 23:30:57 user nova-compute[75307]:     <acpi/>
Nov 13 23:30:57 user nova-compute[75307]:     <apic/>
Nov 13 23:30:57 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:30:57 user nova-compute[75307]:   </features>
Nov 13 23:30:57 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:30:57 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:30:57 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:30:57 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:30:57 user nova-compute[75307]:   </clock>
Nov 13 23:30:57 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:30:57 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:30:57 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:30:57 user nova-compute[75307]:   </cpu>
Nov 13 23:30:57 user nova-compute[75307]:   <devices>
Nov 13 23:30:57 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:30:57 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:30:57 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk"/>
Nov 13 23:30:57 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:30:57 user nova-compute[75307]:     </disk>
Nov 13 23:30:57 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:30:57 user nova-compute[75307]:       <mac address="fa:16:3e:e8:38:6d"/>
Nov 13 23:30:57 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:30:57 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:30:57 user nova-compute[75307]:       <target dev="tapfe50f192-d2"/>
Nov 13 23:30:57 user nova-compute[75307]:     </interface>
Nov 13 23:30:57 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:30:57 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/console.log" append="off"/>
Nov 13 23:30:57 user nova-compute[75307]:     </serial>
Nov 13 23:30:57 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:30:57 user nova-compute[75307]:     <video>
Nov 13 23:30:57 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:30:57 user nova-compute[75307]:     </video>
Nov 13 23:30:57 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:30:57 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:30:57 user nova-compute[75307]:     </rng>
Nov 13 23:30:57 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:30:57 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:30:57 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:30:57 user nova-compute[75307]:     </memballoon>
Nov 13 23:30:57 user nova-compute[75307]:   </devices>
Nov 13 23:30:57 user nova-compute[75307]: </domain>
Nov 13 23:30:57 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697303006',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697303006',id=36,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-8qmv1pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:30:55Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f619c353-0802-4546-a6e3-4a9b1e89f084,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG os_vif [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fd23ed5a-f30a-5018-8a8a-4e0a2acc77a0', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe50f192-d2, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfe50f192-d2, col_values=(('qos', UUID('ab599a79-4eb5-47ca-87f8-53f5c143cdd1')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfe50f192-d2, col_values=(('external_ids', {'iface-id': 'fe50f192-d26e-4b53-b5e8-b428aed38da4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:38:6d', 'vm-uuid': 'f619c353-0802-4546-a6e3-4a9b1e89f084'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: INFO os_vif [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2')
Nov 13 23:30:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.778s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== connect_volume: return (1780ms) {'type': 'block', 'scsi_wwn': '26661656662336134', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661656662336134', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:e8:38:6d, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:30:57 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:30:57 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:30:57 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:30:57 user nova-compute[75307]:   <serial>b7079823-4b44-4246-8353-803bf0966469</serial>
Nov 13 23:30:57 user nova-compute[75307]: </disk>
Nov 13 23:30:57 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.neutron [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated VIF entry in instance network info cache for port fe50f192-d26e-4b53-b5e8-b428aed38da4. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.network.neutron [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-6ee4d750-fa18-4894-88c6-46e7f9fed6e9 req-468c0e09-b20a-4cf3-98b6-a47b1d6585dc service nova] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:30:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:84:3c:96, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:30:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a23392c-45a0-41a8-9cba-0e547a8a4f40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.107s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] No waiting events found dispatching network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:30:59 user nova-compute[75307]: WARNING nova.compute.manager [req-29bb8862-f6ca-492b-9c21-41dd87c13459 req-632c737a-d0b8-45ba-b7e8-3862162bde20 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received unexpected event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 for instance with vm_state building and task_state spawning.
Nov 13 23:30:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:30:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Instance spawned successfully.
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.compute.manager [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Took 6.33 seconds to build instance.
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-df0987ab-4c01-4d06-b33a-ceeea4cd6dc7 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.439s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] No waiting events found dispatching network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:31:01 user nova-compute[75307]: WARNING nova.compute.manager [req-5d1c6a22-ba4a-49e6-92c8-16965d97a9af req-f5b1cb90-e8b7-41e6-9fdf-732f627e5724 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received unexpected event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 for instance with vm_state active and task_state None.
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.compute.claims [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Claim successful on node user
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.policy [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1bf68aa47d54db7b01286e246e2e655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048088f95c114110be9def433f1fd534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:31:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Creating image(s)
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "/opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.217s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk 1073741824" returned: 0 in 0.064s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Successfully created port: 30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Cannot resize image /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Ensure instance console log exists: /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Successfully updated port: 30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquired lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-changed-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Refreshing instance network info cache due to event network-changed-30490d2b-2d13-440f-af2c-5593d781f9d0. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] Acquiring lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updating instance_info_cache with network_info: [{"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Releasing lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Instance network_info: |[{"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] Acquired lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Refreshing network info cache for port 30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Start _get_guest_xml network_info=[{"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:31:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:31:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-284126335',display_name='tempest-AttachVolumeNegativeTest-server-284126335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-284126335',id=37,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuulXYEKWdHR20RjcnbnUKUbBOq1tZLA2hUcWKIve6srbwCM64oRbAVVfZbMRryPfRkP6kZPCq9/FDPSn1WdGjqTkqjaZXtn+N6Nd78zupY29KwGQHZwDYkU2zAMIvi/w==',key_name='tempest-keypair-1282263382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-qhmg3zpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=825f5515-26a8-4cbb-8af0-e1564db4d344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'pci_devices' on Instance uuid 825f5515-26a8-4cbb-8af0-e1564db4d344 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:31:03 user nova-compute[75307]:   <uuid>825f5515-26a8-4cbb-8af0-e1564db4d344</uuid>
Nov 13 23:31:03 user nova-compute[75307]:   <name>instance-00000025</name>
Nov 13 23:31:03 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:31:03 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:31:03 user nova-compute[75307]:   <metadata>
Nov 13 23:31:03 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:31:03 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeNegativeTest-server-284126335</nova:name>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:31:03</nova:creationTime>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:31:03 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:31:03 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:owner>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:user uuid="f1bf68aa47d54db7b01286e246e2e655">tempest-AttachVolumeNegativeTest-676261937-project-member</nova:user>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:project uuid="048088f95c114110be9def433f1fd534">tempest-AttachVolumeNegativeTest-676261937</nova:project>
Nov 13 23:31:03 user nova-compute[75307]:       </nova:owner>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:31:03 user nova-compute[75307]:       <nova:ports>
Nov 13 23:31:03 user nova-compute[75307]:         <nova:port uuid="30490d2b-2d13-440f-af2c-5593d781f9d0">
Nov 13 23:31:03 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 23:31:03 user nova-compute[75307]:         </nova:port>
Nov 13 23:31:03 user nova-compute[75307]:       </nova:ports>
Nov 13 23:31:03 user nova-compute[75307]:     </nova:instance>
Nov 13 23:31:03 user nova-compute[75307]:   </metadata>
Nov 13 23:31:03 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:31:03 user nova-compute[75307]:     <system>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="serial">825f5515-26a8-4cbb-8af0-e1564db4d344</entry>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="uuid">825f5515-26a8-4cbb-8af0-e1564db4d344</entry>
Nov 13 23:31:03 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:31:03 user nova-compute[75307]:     </system>
Nov 13 23:31:03 user nova-compute[75307]:   </sysinfo>
Nov 13 23:31:03 user nova-compute[75307]:   <os>
Nov 13 23:31:03 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:31:03 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:31:03 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:31:03 user nova-compute[75307]:   </os>
Nov 13 23:31:03 user nova-compute[75307]:   <features>
Nov 13 23:31:03 user nova-compute[75307]:     <acpi/>
Nov 13 23:31:03 user nova-compute[75307]:     <apic/>
Nov 13 23:31:03 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:31:03 user nova-compute[75307]:   </features>
Nov 13 23:31:03 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:31:03 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:31:03 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:31:03 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:31:03 user nova-compute[75307]:   </clock>
Nov 13 23:31:03 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:31:03 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:31:03 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:31:03 user nova-compute[75307]:   </cpu>
Nov 13 23:31:03 user nova-compute[75307]:   <devices>
Nov 13 23:31:03 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:31:03 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:31:03 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk"/>
Nov 13 23:31:03 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:31:03 user nova-compute[75307]:     </disk>
Nov 13 23:31:03 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:31:03 user nova-compute[75307]:       <mac address="fa:16:3e:72:85:38"/>
Nov 13 23:31:03 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:31:03 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:31:03 user nova-compute[75307]:       <target dev="tap30490d2b-2d"/>
Nov 13 23:31:03 user nova-compute[75307]:     </interface>
Nov 13 23:31:03 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:31:03 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/console.log" append="off"/>
Nov 13 23:31:03 user nova-compute[75307]:     </serial>
Nov 13 23:31:03 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:31:03 user nova-compute[75307]:     <video>
Nov 13 23:31:03 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:31:03 user nova-compute[75307]:     </video>
Nov 13 23:31:03 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:31:03 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:31:03 user nova-compute[75307]:     </rng>
Nov 13 23:31:03 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:31:03 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:31:03 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:31:03 user nova-compute[75307]:     </memballoon>
Nov 13 23:31:03 user nova-compute[75307]:   </devices>
Nov 13 23:31:03 user nova-compute[75307]: </domain>
Nov 13 23:31:03 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-284126335',display_name='tempest-AttachVolumeNegativeTest-server-284126335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-284126335',id=37,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuulXYEKWdHR20RjcnbnUKUbBOq1tZLA2hUcWKIve6srbwCM64oRbAVVfZbMRryPfRkP6kZPCq9/FDPSn1WdGjqTkqjaZXtn+N6Nd78zupY29KwGQHZwDYkU2zAMIvi/w==',key_name='tempest-keypair-1282263382',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-qhmg3zpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:31:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=825f5515-26a8-4cbb-8af0-e1564db4d344,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG os_vif [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e07dad7-d051-53b2-bd61-d9edae123ceb', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30490d2b-2d, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap30490d2b-2d, col_values=(('qos', UUID('7cba01d3-90bf-437f-b0b6-4b194821432a')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap30490d2b-2d, col_values=(('external_ids', {'iface-id': '30490d2b-2d13-440f-af2c-5593d781f9d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:85:38', 'vm-uuid': '825f5515-26a8-4cbb-8af0-e1564db4d344'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:03 user nova-compute[75307]: INFO os_vif [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d')
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:31:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:72:85:38, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updated VIF entry in instance network info cache for port 30490d2b-2d13-440f-af2c-5593d781f9d0. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updating instance_info_cache with network_info: [{"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9b9b9554-91c3-4037-8a20-6e869b500c5c req-21b246f9-2f55-4b57-b622-d1e2f80d73fa service nova] Releasing lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing instance network info cache due to event network-changed-eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] Acquiring lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] Acquired lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Refreshing network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:04 user nova-compute[75307]: INFO nova.compute.manager [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Terminating instance
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-unplugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] No waiting events found dispatching network-vif-unplugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-a8bf7561-d193-460f-a4d5-a7a7f1536de0 req-d2a07079-d870-4878-9006-ae11c08ce015 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-unplugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updated VIF entry in instance network info cache for port eafe0117-bd9d-49e4-8866-7d470c0a0ed3. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [{"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:31:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dbb53e8c-ced3-4b53-861a-8dc27862277b req-879f711d-74ad-4bd0-b5d1-073824d0a3c2 service nova] Releasing lock "refresh_cache-25c8b300-4c7b-4370-b014-41b0085dc217" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Instance destroyed successfully.
Nov 13 23:31:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lazy-loading 'resources' on Instance uuid 25c8b300-4c7b-4370-b014-41b0085dc217 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-204055908',display_name='tempest-TestVolumeBootPattern-server-204055908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-204055908',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVAgon1r+OMqogluKNFh7/2yi4T2e5rGVcpkJnJZWWbNRLiTtTTe00rjukklwITaNfwON58e8lx5K/1YgmnH5KqW6nsaNbqziOzmCkjkWNwpEVoUBXBM8WuQKtZJqeWwA==',key_name='tempest-TestVolumeBootPattern-72983062',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2f7dd660313a41b9a468835b35ceca8b',ramdisk_id='',reservation_id='r-zd9j8azt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-234629115',owner_user_name='tempest-TestVolumeBootPattern-234629115-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:26:35Z,user_data=None,user_id='119a5d0012a44e1a8fb19a781aed09ce',uuid=25c8b300-4c7b-4370-b014-41b0085dc217,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converting VIF {"id": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "address": "fa:16:3e:c4:38:69", "network": {"id": "79d2bd19-76c0-451e-ae23-aa4d8b03d33a", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1993062819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2f7dd660313a41b9a468835b35ceca8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeafe0117-bd", "ovs_interfaceid": "eafe0117-bd9d-49e4-8866-7d470c0a0ed3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_vif [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeafe0117-bd, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=106987e7-a233-46d3-9ede-ecfcab97ae0c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:31:05 user nova-compute[75307]: INFO os_vif [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c4:38:69,bridge_name='br-int',has_traffic_filtering=True,id=eafe0117-bd9d-49e4-8866-7d470c0a0ed3,network=Network(79d2bd19-76c0-451e-ae23-aa4d8b03d33a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeafe0117-bd')
Nov 13 23:31:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xHtiVsSL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:31:05 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab066f6-368f-4e18-8559-a7e3a1c091f7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:31:05 user nova-compute[75307]: No targets found.
Nov 13 23:31:05 user nova-compute[75307]: iSNS:
Nov 13 23:31:05 user nova-compute[75307]: No targets found.
Nov 13 23:31:05 user nova-compute[75307]: STATIC:
Nov 13 23:31:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:31:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:31:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:31:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469
Nov 13 23:31:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:31:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:31:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70
Nov 13 23:31:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:31:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:31:05 user nova-compute[75307]: FIRMWARE:
Nov 13 23:31:05 user nova-compute[75307]: No targets found.
Nov 13 23:31:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:31:05 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:31:05 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[288aca44-b8df-4bab-b090-a5e955ab8b8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[211a172a-0907-4292-b1f1-f3052c5bb54e]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:31:05 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:31:05 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:31:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 (non-flash)
Nov 13 23:31:05 user nova-compute[75307]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:31:05 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:31:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3433b910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec0f847-73ef-41d9-872d-21bc33180a62]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c1eeb2-593a-4598-8b4c-376d457e441c]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ec480f-3a4e-48dc-bea5-ecbb8ff25895]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec679e7-1dc9-4bfb-8fa6-bc9e4893d42e]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de86a86-627b-4a3e-b9a0-2f2760af95b4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:31:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b807f42-782b-4062-9521-8cf50e986039]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260]
Nov 13 23:31:06 user nova-compute[75307]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70, portal: 172.16.0.220,3260] successful.
Nov 13 23:31:06 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:799fe3d4-f050-4fc8-8bee-2b3b0b188c70 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[770135c7-e005-4000-baa4-884149752a61]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] <== disconnect_volume: return (341ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:31:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Deleting instance files /opt/stack/data/nova/instances/25c8b300-4c7b-4370-b014-41b0085dc217_del
Nov 13 23:31:06 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Deletion of /opt/stack/data/nova/instances/25c8b300-4c7b-4370-b014-41b0085dc217_del complete
Nov 13 23:31:06 user nova-compute[75307]: INFO nova.compute.manager [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Took 1.65 seconds to destroy the instance on the hypervisor.
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:31:06 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Took 0.47 seconds to deallocate network for instance.
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-79329f41-0881-4e80-9b47-81e07eb7f56b req-1488c891-3c26-4818-9744-81f4108dcb34 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-deleted-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Acquiring lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "25c8b300-4c7b-4370-b014-41b0085dc217-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] No waiting events found dispatching network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:31:06 user nova-compute[75307]: WARNING nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Received unexpected event network-vif-plugged-eafe0117-bd9d-49e4-8866-7d470c0a0ed3 for instance with vm_state active and task_state deleting.
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] No waiting events found dispatching network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:31:06 user nova-compute[75307]: WARNING nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received unexpected event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 for instance with vm_state building and task_state spawning.
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] No waiting events found dispatching network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:31:06 user nova-compute[75307]: WARNING nova.compute.manager [req-44c92106-a433-4d12-9cec-2f9a92aac4fe req-e693373c-9cd3-48e9-a8b6-60d2c51a1749 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received unexpected event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 for instance with vm_state building and task_state spawning.
Nov 13 23:31:07 user nova-compute[75307]: INFO nova.compute.manager [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] [instance: 25c8b300-4c7b-4370-b014-41b0085dc217] Took 0.70 seconds to detach 1 volumes for instance.
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:31:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Instance spawned successfully.
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.257s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:07 user nova-compute[75307]: INFO nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 13 23:31:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:31:07 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Deleted allocations for instance 25c8b300-4c7b-4370-b014-41b0085dc217
Nov 13 23:31:07 user nova-compute[75307]: INFO nova.compute.manager [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Took 6.36 seconds to build instance.
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6d3e3862-dadb-4d20-9a4b-164ff21b0549 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.453s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0b0e01d-0c34-4d9d-bd0d-bfb2dca7a652 tempest-TestVolumeBootPattern-234629115 tempest-TestVolumeBootPattern-234629115-project-member] Lock "25c8b300-4c7b-4370-b014-41b0085dc217" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.253s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:31:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:31:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:31:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:31:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:31:16 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updating instance_info_cache with network_info: [{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:17 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:31:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:31:19 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:31:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8086MB free_disk=25.376232147216797GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 825f5515-26a8-4cbb-8af0-e1564db4d344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 8bf8a928-35cc-413a-b7e8-5afeecb20924 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 81ca5221-bb7d-4587-999b-c772bfe99128 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 825f5515-26a8-4cbb-8af0-e1564db4d344 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.046s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:31:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:31:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:32:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-changed-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing instance network info cache due to event network-changed-872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Refreshing network info cache for port 872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated VIF entry in instance network info cache for port 872b038e-7eab-4644-bf2b-11a948011758. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:32:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5531c97-2de5-49a7-af05-456ac3c99872 req-767c6562-0b02-4063-a7ae-0d0b673834bd service nova] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 8bf8a928-35cc-413a-b7e8-5afeecb20924 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [{"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-8bf8a928-35cc-413a-b7e8-5afeecb20924" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Stashing vm_state: active {{(pid=75307) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:32:18 user nova-compute[75307]: INFO nova.compute.claims [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Claim successful on node user
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-changed-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Refreshing instance network info cache due to event network-changed-f3cb8024-52d1-42b1-81b5-1f5eee8e079c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Refreshing network info cache for port f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:18 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating resource usage from migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.384s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:18 user nova-compute[75307]: INFO nova.compute.manager [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Migrating
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.312s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:32:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updated VIF entry in instance network info cache for port f3cb8024-52d1-42b1-81b5-1f5eee8e079c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b0f8d19b-fdd5-4908-ab13-ad758969234b req-5c9bcdb6-99aa-460d-b73f-7341acb21dd4 service nova] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Starting migrate_disk_and_power_off {{(pid=75307) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:19 user nova-compute[75307]: WARNING nova.compute.manager [req-a50a3ba7-7c97-43f9-836f-26d4b288bfb1 req-3b237d9d-6f81-4b58-aa60-1a59bee44aea service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state resize_migrating.
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance destroyed successfully.
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:32:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3cb8024-52, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2072b705-2123-4177-9d88-9a00115c0b8c) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:20 user nova-compute[75307]: INFO os_vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52')
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:32:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[55daa70b-ff43-4588-bb3e-a8c3ffcb28ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:32:20 user nova-compute[75307]: No targets found.
Nov 13 23:32:20 user nova-compute[75307]: iSNS:
Nov 13 23:32:20 user nova-compute[75307]: No targets found.
Nov 13 23:32:20 user nova-compute[75307]: STATIC:
Nov 13 23:32:20 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:32:20 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:32:20 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:32:20 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469
Nov 13 23:32:20 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:32:20 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:32:20 user nova-compute[75307]: FIRMWARE:
Nov 13 23:32:20 user nova-compute[75307]: No targets found.
Nov 13 23:32:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:32:20 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:32:20 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8612d73d-a8d2-4c51-b310-949f58009d77]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5b1a384-ea12-4e8c-8ce9-dc02110ffe1d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:32:20 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:32:20 user nova-compute[75307]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb346f3e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed6eb4-58a7-423b-a5c8-9c813e0aa380]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ffddf9-84ce-4a42-97f0-22f8c3a7cdfd]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[53929c5d-ea77-4769-b01c-8e8285f294eb]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ae892b-15aa-4ab4-9efb-b8fda7451314]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf0e20e2e-f7a358ac95bd45a4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0e20e2e', '/dev/disk/by-id/scsi-26637613335386163') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1424d84d-1944-4cc8-bdca-539562e45766]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[34bf7727-66e8-4be3-b388-26f2a8394c6d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf80847-fd08-4e5e-a736-e5328c442d21]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]
Nov 13 23:32:20 user nova-compute[75307]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.
Nov 13 23:32:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f880f5db-cd80-4cb0-85a8-fb6b475ea2f7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== disconnect_volume: return (426ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:21 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:21 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8230MB free_disk=25.318988800048828GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:32:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:22 user nova-compute[75307]: WARNING nova.compute.manager [req-bd83fdc2-9910-4bdd-8f91-dada2e664ff8 req-6675ea29-0da5-4da7-9cb1-07f59e2f9f98 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state resize_migrating.
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Applying migration context for instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c as it has an incoming, in-progress migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d. Migration status is migrating {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 23:32:22 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating resource usage from migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 825f5515-26a8-4cbb-8af0-e1564db4d344 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Port f3cb8024-52d1-42b1-81b5-1f5eee8e079c binding to destination host user is already ACTIVE {{(pid=75307) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.487s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG os_brick.utils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d1559b-9f2b-46e5-a213-b47e7c05669b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ee4968-95a6-4561-86e3-ec1404f72b84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02a19b4-440b-44ab-a33a-586721a11555]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebaae17a-387d-4889-8499-5c00657f7ba7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:32:23 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:32:23 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee66331-a3bf-44f1-8db4-860bd5fba4d3]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG os_brick.utils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:32:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:32:24 user nova-compute[75307]: INFO nova.compute.claims [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Claim successful on node user
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:32:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.policy [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cc3bbf1a6a445d95ce63c5d7df7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0c1d1aed13442eb606411efb5b14eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:32:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Creating image(s)
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "/opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "/opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "/opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Successfully created port: a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk 1073741824" returned: 0 in 0.054s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Cannot resize image /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Ensure instance console log exists: /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Successfully updated port: a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquired lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-changed-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Refreshing instance network info cache due to event network-changed-a9fe3361-15c7-409c-aec5-e5e511a86f2c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] Acquiring lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating instance_info_cache with network_info: [{"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Releasing lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Instance network_info: |[{"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] Acquired lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Refreshing network info cache for port a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Start _get_guest_xml network_info=[{"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:32:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377208385',display_name='tempest-VolumesSnapshotTestJSON-instance-1377208385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377208385',id=38,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqfBV/YWHa1mC8VcVu2AKAW3SU1WSjqdyIBNQYOKofPFjAiUqTvUmwgaIQ3nFJWaZ7otLhp9lSyJKTrcoU+9K+85ZH5t74BNuoWz61Kud4kaBjkvdFmzDHiQMew1lszsQ==',key_name='tempest-keypair-1570157988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-u59ij9rp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=65130eff-823f-43cc-b861-02a9d5d4438e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.objects.instance [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'pci_devices' on Instance uuid 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:32:27 user nova-compute[75307]:   <uuid>65130eff-823f-43cc-b861-02a9d5d4438e</uuid>
Nov 13 23:32:27 user nova-compute[75307]:   <name>instance-00000026</name>
Nov 13 23:32:27 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:32:27 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:32:27 user nova-compute[75307]:   <metadata>
Nov 13 23:32:27 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:32:27 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1377208385</nova:name>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:32:27</nova:creationTime>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:32:27 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:32:27 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:owner>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:user uuid="76cc3bbf1a6a445d95ce63c5d7df7d8d">tempest-VolumesSnapshotTestJSON-113181125-project-member</nova:user>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:project uuid="fc0c1d1aed13442eb606411efb5b14eb">tempest-VolumesSnapshotTestJSON-113181125</nova:project>
Nov 13 23:32:27 user nova-compute[75307]:       </nova:owner>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:32:27 user nova-compute[75307]:       <nova:ports>
Nov 13 23:32:27 user nova-compute[75307]:         <nova:port uuid="a9fe3361-15c7-409c-aec5-e5e511a86f2c">
Nov 13 23:32:27 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 23:32:27 user nova-compute[75307]:         </nova:port>
Nov 13 23:32:27 user nova-compute[75307]:       </nova:ports>
Nov 13 23:32:27 user nova-compute[75307]:     </nova:instance>
Nov 13 23:32:27 user nova-compute[75307]:   </metadata>
Nov 13 23:32:27 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:32:27 user nova-compute[75307]:     <system>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="serial">65130eff-823f-43cc-b861-02a9d5d4438e</entry>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="uuid">65130eff-823f-43cc-b861-02a9d5d4438e</entry>
Nov 13 23:32:27 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:32:27 user nova-compute[75307]:     </system>
Nov 13 23:32:27 user nova-compute[75307]:   </sysinfo>
Nov 13 23:32:27 user nova-compute[75307]:   <os>
Nov 13 23:32:27 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:32:27 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:32:27 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:32:27 user nova-compute[75307]:   </os>
Nov 13 23:32:27 user nova-compute[75307]:   <features>
Nov 13 23:32:27 user nova-compute[75307]:     <acpi/>
Nov 13 23:32:27 user nova-compute[75307]:     <apic/>
Nov 13 23:32:27 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:32:27 user nova-compute[75307]:   </features>
Nov 13 23:32:27 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:32:27 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:32:27 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:32:27 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:32:27 user nova-compute[75307]:   </clock>
Nov 13 23:32:27 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:32:27 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:32:27 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:32:27 user nova-compute[75307]:   </cpu>
Nov 13 23:32:27 user nova-compute[75307]:   <devices>
Nov 13 23:32:27 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:32:27 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:32:27 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk"/>
Nov 13 23:32:27 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:32:27 user nova-compute[75307]:     </disk>
Nov 13 23:32:27 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:32:27 user nova-compute[75307]:       <mac address="fa:16:3e:69:db:bd"/>
Nov 13 23:32:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:32:27 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:32:27 user nova-compute[75307]:       <target dev="tapa9fe3361-15"/>
Nov 13 23:32:27 user nova-compute[75307]:     </interface>
Nov 13 23:32:27 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:32:27 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/console.log" append="off"/>
Nov 13 23:32:27 user nova-compute[75307]:     </serial>
Nov 13 23:32:27 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:32:27 user nova-compute[75307]:     <video>
Nov 13 23:32:27 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:32:27 user nova-compute[75307]:     </video>
Nov 13 23:32:27 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:32:27 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:32:27 user nova-compute[75307]:     </rng>
Nov 13 23:32:27 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:32:27 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:32:27 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:32:27 user nova-compute[75307]:     </memballoon>
Nov 13 23:32:27 user nova-compute[75307]:   </devices>
Nov 13 23:32:27 user nova-compute[75307]: </domain>
Nov 13 23:32:27 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377208385',display_name='tempest-VolumesSnapshotTestJSON-instance-1377208385',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377208385',id=38,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqfBV/YWHa1mC8VcVu2AKAW3SU1WSjqdyIBNQYOKofPFjAiUqTvUmwgaIQ3nFJWaZ7otLhp9lSyJKTrcoU+9K+85ZH5t74BNuoWz61Kud4kaBjkvdFmzDHiQMew1lszsQ==',key_name='tempest-keypair-1570157988',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-u59ij9rp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:32:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=65130eff-823f-43cc-b861-02a9d5d4438e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_vif [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2d3c1792-fc61-544b-ace4-736bfb80342e', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa9fe3361-15, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa9fe3361-15, col_values=(('qos', UUID('d3eb1b94-7c65-4112-b788-bbf83557d215')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa9fe3361-15, col_values=(('external_ids', {'iface-id': 'a9fe3361-15c7-409c-aec5-e5e511a86f2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:db:bd', 'vm-uuid': '65130eff-823f-43cc-b861-02a9d5d4438e'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:27 user nova-compute[75307]: INFO os_vif [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15')
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Starting finish_migration {{(pid=75307) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:32:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Creating image(s)
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Ensure instance console log exists: /opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start _get_guest_xml network_info=[{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '4afb051a-6ad3-4d1b-b5f7-832ad997bd9c', 'attached_at': '2023-11-13T23:32:27.000000', 'detached_at': '', 'volume_id': 'fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'serial': 'fe89a298-e459-4821-b0fd-c5cfa0e4047a'}, 'delete_on_termination': True, 'attachment_id': '842e1553-b3cb-45d7-aa63-95902a07b30b', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:32:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:13Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:32:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:32:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:32:27 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b047525-8b5a-4a2d-9e94-c1e98dac0460]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:32:27 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No VIF found with MAC fa:16:3e:69:db:bd, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d094c9-2161-4dff-be45-f2cdceed1f4d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a] added
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[504e6c65-36af-4c49-82c0-e58b4b2ecb3b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[577deb34-738e-4831-b122-b81676b2f378]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TenGdtEF {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TenGdtEF" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c0d88-c819-4fc3-ac13-295e2a0890d7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TenGdtEF'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fd35fd-1d18-4b98-a2e3-1bfbfceca16d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[300dd80b-a19c-4650-a7e7-835e3ef1a783]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updated VIF entry in instance network info cache for port a9fe3361-15c7-409c-aec5-e5e511a86f2c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating instance_info_cache with network_info: [{"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3767950f-e81a-4d61-98b4-19a837bd7a51 req-1d1b1c4f-f20d-4a6f-a507-8735c1c1d6fb service nova] Releasing lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[535a59f0-25c2-46ee-8a4f-e5e2ece636a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]
Nov 13 23:32:27 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0917f915-8294-4512-b690-468763de49e5]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b0c37b-2f4b-4d04-b7f7-829a34bf620f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:27 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:32:27 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:32:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df66f001-48e6-4555-8059-1b26f58ff02b]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:32:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26637613335386163', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613335386163', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:32:28 user nova-compute[75307]:   <uuid>4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</uuid>
Nov 13 23:32:28 user nova-compute[75307]:   <name>instance-00000023</name>
Nov 13 23:32:28 user nova-compute[75307]:   <memory>2097152</memory>
Nov 13 23:32:28 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:32:28 user nova-compute[75307]:   <metadata>
Nov 13 23:32:28 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:32:28 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:32:28 user nova-compute[75307]:       <nova:name>tempest-ServerActionsTestOtherA-server-1777366366</nova:name>
Nov 13 23:32:28 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:32:27</nova:creationTime>
Nov 13 23:32:28 user nova-compute[75307]:       <nova:flavor name="m1.small">
Nov 13 23:32:28 user nova-compute[75307]:         <nova:memory>2048</nova:memory>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:disk>20</nova:disk>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:32:28 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:32:28 user nova-compute[75307]:       <nova:owner>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:user uuid="7b605f62d134435896eb5dce0b48d51c">tempest-ServerActionsTestOtherA-708902499-project-member</nova:user>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:project uuid="f4260b68885d4f5ebfa01306bf64a9b9">tempest-ServerActionsTestOtherA-708902499</nova:project>
Nov 13 23:32:28 user nova-compute[75307]:       </nova:owner>
Nov 13 23:32:28 user nova-compute[75307]:       <nova:ports>
Nov 13 23:32:28 user nova-compute[75307]:         <nova:port uuid="f3cb8024-52d1-42b1-81b5-1f5eee8e079c">
Nov 13 23:32:28 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 13 23:32:28 user nova-compute[75307]:         </nova:port>
Nov 13 23:32:28 user nova-compute[75307]:       </nova:ports>
Nov 13 23:32:28 user nova-compute[75307]:     </nova:instance>
Nov 13 23:32:28 user nova-compute[75307]:   </metadata>
Nov 13 23:32:28 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:32:28 user nova-compute[75307]:     <system>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="serial">4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</entry>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="uuid">4afb051a-6ad3-4d1b-b5f7-832ad997bd9c</entry>
Nov 13 23:32:28 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:32:28 user nova-compute[75307]:     </system>
Nov 13 23:32:28 user nova-compute[75307]:   </sysinfo>
Nov 13 23:32:28 user nova-compute[75307]:   <os>
Nov 13 23:32:28 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:32:28 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:32:28 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:32:28 user nova-compute[75307]:   </os>
Nov 13 23:32:28 user nova-compute[75307]:   <features>
Nov 13 23:32:28 user nova-compute[75307]:     <acpi/>
Nov 13 23:32:28 user nova-compute[75307]:     <apic/>
Nov 13 23:32:28 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:32:28 user nova-compute[75307]:   </features>
Nov 13 23:32:28 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:32:28 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:32:28 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:32:28 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:32:28 user nova-compute[75307]:   </clock>
Nov 13 23:32:28 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:32:28 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:32:28 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:32:28 user nova-compute[75307]:   </cpu>
Nov 13 23:32:28 user nova-compute[75307]:   <devices>
Nov 13 23:32:28 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:32:28 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:32:28 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:32:28 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:32:28 user nova-compute[75307]:       <serial>fe89a298-e459-4821-b0fd-c5cfa0e4047a</serial>
Nov 13 23:32:28 user nova-compute[75307]:     </disk>
Nov 13 23:32:28 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:32:28 user nova-compute[75307]:       <mac address="fa:16:3e:91:44:9a"/>
Nov 13 23:32:28 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:32:28 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:32:28 user nova-compute[75307]:       <target dev="tapf3cb8024-52"/>
Nov 13 23:32:28 user nova-compute[75307]:     </interface>
Nov 13 23:32:28 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:32:28 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c/console.log" append="off"/>
Nov 13 23:32:28 user nova-compute[75307]:     </serial>
Nov 13 23:32:28 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:32:28 user nova-compute[75307]:     <video>
Nov 13 23:32:28 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:32:28 user nova-compute[75307]:     </video>
Nov 13 23:32:28 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:32:28 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:32:28 user nova-compute[75307]:     </rng>
Nov 13 23:32:28 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:32:28 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:32:28 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:32:28 user nova-compute[75307]:     </memballoon>
Nov 13 23:32:28 user nova-compute[75307]:   </devices>
Nov 13 23:32:28 user nova-compute[75307]: </domain>
Nov 13 23:32:28 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:30:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:32:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-507396201-network", "vif_mac": "fa:16:3e:91:44:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG os_vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25125510-2a1a-5736-a7d0-00f61421b197', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3cb8024-52, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3cb8024-52, col_values=(('qos', UUID('2a7e1c12-8f8d-4f3e-bcca-4346cd547411')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3cb8024-52, col_values=(('external_ids', {'iface-id': 'f3cb8024-52d1-42b1-81b5-1f5eee8e079c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:44:9a', 'vm-uuid': '4afb051a-6ad3-4d1b-b5f7-832ad997bd9c'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:28 user nova-compute[75307]: INFO os_vif [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52')
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] No VIF found with MAC fa:16:3e:91:44:9a, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] No waiting events found dispatching network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:28 user nova-compute[75307]: WARNING nova.compute.manager [req-3a5c7d70-0ce4-411b-ac74-ae7fee972e0b req-d1638dc2-c2e0-41fd-8494-8a712ff6404f service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received unexpected event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c for instance with vm_state building and task_state spawning.
Nov 13 23:32:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:30 user nova-compute[75307]: WARNING nova.compute.manager [req-72ad7e65-66c2-4bd3-91de-cbfb214956c3 req-daa44bdb-4521-4ffb-a746-d2061818a481 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state resize_finish.
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] No waiting events found dispatching network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:30 user nova-compute[75307]: WARNING nova.compute.manager [req-92507f1f-d4e7-4d10-a096-54a60a80b96b req-8be9d764-b415-4f17-bd06-b5265288c068 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received unexpected event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c for instance with vm_state building and task_state spawning.
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:32:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Instance spawned successfully.
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:32:31 user nova-compute[75307]: INFO nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 13 23:32:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:32:31 user nova-compute[75307]: INFO nova.compute.manager [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Took 7.02 seconds to build instance.
Nov 13 23:32:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-38d5986e-78e9-40d9-a800-2a81e4fdb78c tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.120s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:32:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance running successfully.
Nov 13 23:32:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Failed to set time: agent not configured {{(pid=75307) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f1fe3356-e7db-4dba-a9ad-36a2abb16aa4 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] finish_migration finished successfully. {{(pid=75307) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:32 user nova-compute[75307]: WARNING nova.compute.manager [req-b87d6353-a938-4b33-aa69-b3f572f1a9bb req-c298fa6f-1ff3-4461-bbc1-965134d5dd12 service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state resize_finish.
Nov 13 23:32:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:45 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:32:46 user nova-compute[75307]: INFO nova.compute.manager [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] instance snapshotting
Nov 13 23:32:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Beginning live snapshot process
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json -f qcow2" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd.delta 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd.delta 1073741824" returned: 0 in 0.049s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 23:32:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:32:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] COPY block job progress, current cursor: 28180480 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:32:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:32:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 23:32:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:48 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:32:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd.delta /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:32:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd.delta /opt/stack/data/nova/instances/snapshots/tmpdx3s0j__/8ec3430f99a245a88c81f238c758dffd" returned: 0 in 0.405s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:32:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Snapshot extracted, beginning image upload
Nov 13 23:32:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Snapshot image upload complete
Nov 13 23:32:51 user nova-compute[75307]: INFO nova.compute.manager [None req-f2f395b0-929b-4d37-bae7-dce1c2d17a76 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Took 5.49 seconds to snapshot the instance on the hypervisor.
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-changed-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Refreshing instance network info cache due to event network-changed-30490d2b-2d13-440f-af2c-5593d781f9d0. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] Acquiring lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] Acquired lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.network.neutron [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Refreshing network info cache for port 30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:52 user nova-compute[75307]: INFO nova.compute.manager [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Terminating instance
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.network.neutron [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updated VIF entry in instance network info cache for port 30490d2b-2d13-440f-af2c-5593d781f9d0. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG nova.network.neutron [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updating instance_info_cache with network_info: [{"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aa235531-9aea-4b4f-99f5-a9e696cfc2aa req-4585debb-36e3-4d26-8c31-b4aa00cafaa0 service nova] Releasing lock "refresh_cache-825f5515-26a8-4cbb-8af0-e1564db4d344" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Instance destroyed successfully.
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.objects.instance [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'resources' on Instance uuid 825f5515-26a8-4cbb-8af0-e1564db4d344 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:31:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-284126335',display_name='tempest-AttachVolumeNegativeTest-server-284126335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-284126335',id=37,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuulXYEKWdHR20RjcnbnUKUbBOq1tZLA2hUcWKIve6srbwCM64oRbAVVfZbMRryPfRkP6kZPCq9/FDPSn1WdGjqTkqjaZXtn+N6Nd78zupY29KwGQHZwDYkU2zAMIvi/w==',key_name='tempest-keypair-1282263382',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:31:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-qhmg3zpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:31:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=825f5515-26a8-4cbb-8af0-e1564db4d344,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "30490d2b-2d13-440f-af2c-5593d781f9d0", "address": "fa:16:3e:72:85:38", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30490d2b-2d", "ovs_interfaceid": "30490d2b-2d13-440f-af2c-5593d781f9d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG os_vif [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30490d2b-2d, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cba01d3-90bf-437f-b0b6-4b194821432a) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:53 user nova-compute[75307]: INFO os_vif [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:85:38,bridge_name='br-int',has_traffic_filtering=True,id=30490d2b-2d13-440f-af2c-5593d781f9d0,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30490d2b-2d')
Nov 13 23:32:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Deleting instance files /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344_del
Nov 13 23:32:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Deletion of /opt/stack/data/nova/instances/825f5515-26a8-4cbb-8af0-e1564db4d344_del complete
Nov 13 23:32:53 user nova-compute[75307]: INFO nova.compute.manager [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 13 23:32:53 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:32:53 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:54 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Took 0.74 seconds to deallocate network for instance.
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-2240f00a-c236-47aa-9c43-75573c5527b7 req-e1922299-e1cb-403b-a09d-5be83a3698f8 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-vif-deleted-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:54 user nova-compute[75307]: INFO nova.compute.manager [req-2240f00a-c236-47aa-9c43-75573c5527b7 req-e1922299-e1cb-403b-a09d-5be83a3698f8 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Neutron deleted interface 30490d2b-2d13-440f-af2c-5593d781f9d0; detaching it from the instance and deleting it from the info cache
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.network.neutron [req-2240f00a-c236-47aa-9c43-75573c5527b7 req-e1922299-e1cb-403b-a09d-5be83a3698f8 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-2240f00a-c236-47aa-9c43-75573c5527b7 req-e1922299-e1cb-403b-a09d-5be83a3698f8 service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Detach interface failed, port_id=30490d2b-2d13-440f-af2c-5593d781f9d0, reason: Instance 825f5515-26a8-4cbb-8af0-e1564db4d344 could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-vif-unplugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] No waiting events found dispatching network-vif-unplugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:54 user nova-compute[75307]: WARNING nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received unexpected event network-vif-unplugged-30490d2b-2d13-440f-af2c-5593d781f9d0 for instance with vm_state deleted and task_state None.
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Acquiring lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] No waiting events found dispatching network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:32:54 user nova-compute[75307]: WARNING nova.compute.manager [req-8acd2433-8c0c-46ed-93a5-b50a1cc76e91 req-f928b5e7-71e3-4936-b425-03ced9b91f9b service nova] [instance: 825f5515-26a8-4cbb-8af0-e1564db4d344] Received unexpected event network-vif-plugged-30490d2b-2d13-440f-af2c-5593d781f9d0 for instance with vm_state deleted and task_state None.
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:54 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Deleted allocations for instance 825f5515-26a8-4cbb-8af0-e1564db4d344
Nov 13 23:32:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-25c5653d-2c7c-4e79-842f-6e3049a568eb tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "825f5515-26a8-4cbb-8af0-e1564db4d344" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:32:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:32:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:33:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:33:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updating instance_info_cache with network_info: [{"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-81ca5221-bb7d-4587-999b-c772bfe99128" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:22 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:33:22 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8218MB free_disk=25.26681900024414GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Applying migration context for instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c as it has an incoming, in-progress migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d. Migration status is finished {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 13 23:33:22 user nova-compute[75307]: INFO nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating resource usage from migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 65130eff-823f-43cc-b861-02a9d5d4438e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:33:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.396s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:33:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:33:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:33:44 user nova-compute[75307]: INFO nova.compute.manager [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Detaching volume b7079823-4b44-4246-8353-803bf0966469
Nov 13 23:33:44 user nova-compute[75307]: INFO nova.virt.block_device [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Attempting to driver detach volume b7079823-4b44-4246-8353-803bf0966469 from mountpoint /dev/vdb
Nov 13 23:33:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Attempting to detach device vdb from instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:33:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:33:44 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:33:44 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:33:44 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:33:44 user nova-compute[75307]:   <serial>b7079823-4b44-4246-8353-803bf0966469</serial>
Nov 13 23:33:44 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:33:44 user nova-compute[75307]: </disk>
Nov 13 23:33:44 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:33:44 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e from the persistent domain config.
Nov 13 23:33:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:33:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:33:44 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:33:44 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:33:44 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:33:44 user nova-compute[75307]:   <serial>b7079823-4b44-4246-8353-803bf0966469</serial>
Nov 13 23:33:44 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:33:44 user nova-compute[75307]: </disk>
Nov 13 23:33:44 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:33:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:33:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:33:53 user nova-compute[75307]: INFO nova.compute.claims [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Claim successful on node user
Nov 13 23:33:53 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.326s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:33:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:33:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:33:54 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:33:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:33:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:33:54 user nova-compute[75307]: DEBUG nova.policy [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049e1cfffeef4a1996a661e5a3894ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324dfec822e6496d9601b2198091aa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:33:54 user nova-compute[75307]: INFO nova.virt.block_device [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Booting with blank volume at /dev/vda
Nov 13 23:33:54 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Successfully created port: 02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Successfully updated port: 02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-changed-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.compute.manager [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Refreshing instance network info cache due to event network-changed-02f43f2f-505a-4165-9510-37b6e163ed68. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance network_info: |[{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:33:55 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Refreshing network info cache for port 02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:33:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updated VIF entry in instance network info cache for port 02f43f2f-505a-4165-9510-37b6e163ed68. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:33:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:33:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-37d68849-0c75-4ff4-8210-4054b8753c2f req-debcfb27-e0d2-4c0d-bb07-8ae5920f0b80 service nova] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:33:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.utils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dc8def-2d2e-411b-873e-65aa50eb5375]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdd1924-e0ef-4e2d-99ee-3f36241ee166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef48bb9-383d-4341-a78b-16ea31e4ec74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[417b98af-5a3b-4b71-8796-3fdad5065108]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:33:59 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:33:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471c0ec-2ec2-48de-8fcd-a3850ebce060]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG os_brick.utils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:33:59 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating existing volume attachment record: c68fcd6d-4407-4dc6-92b8-a545ae8833cf {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:34:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Creating image(s)
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Ensure instance console log exists: /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start _get_guest_xml network_info=[{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3ea4d239-785b-4a80-9cfc-b8ac078c644f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c6b8aca-f813-403b-b862-fe1b48c62be7', 'serial': '7c6b8aca-f813-403b-b862-fe1b48c62be7'}, 'delete_on_termination': False, 'attachment_id': 'c68fcd6d-4407-4dc6-92b8-a545ae8833cf', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:34:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:34:03 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:34:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:04 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:04 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:04 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[293acbd0-6665-427c-af43-af3dc6998276]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:34:04 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4665adc1-788b-4ea6-9cda-971e92518816]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7] added
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[577158a9-6918-4c59-94c6-a66a3bc7c5ea]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecb73d7-cc66-4ccf-83cd-2503f01a5659]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkvWcQsu {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkvWcQsu" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5bc3d9b-9c7b-4d21-ba03-7a1141179db9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkvWcQsu'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de152afd-10aa-45a8-8f9b-f0da1882f041]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[403c98ad-28a3-45b5-b453-8bdf1763cbc3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fe71398-67cf-4928-9b3c-56bff18cc56e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260]
Nov 13 23:34:04 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260] successful.
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a68580-3a56-4a86-9ce4-069f70da9815]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6954baa9-0134-4af0-ae55-d35bff780c75]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:04 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:04 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd67a445-f7f6-457d-9064-894039b1761b]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:34:04 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e is timed out.
Nov 13 23:34:04 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e from the live domain config.
Nov 13 23:34:04 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lcBOzPVJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:04 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:04 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26163376135336161', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163376135336161', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.762s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eda3bee-b48b-49c6-8892-e6b2394535c6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:34:05 user nova-compute[75307]: No targets found.
Nov 13 23:34:05 user nova-compute[75307]: iSNS:
Nov 13 23:34:05 user nova-compute[75307]: No targets found.
Nov 13 23:34:05 user nova-compute[75307]: STATIC:
Nov 13 23:34:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:34:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469
Nov 13 23:34:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:05 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:34:05 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:05 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:05 user nova-compute[75307]: FIRMWARE:
Nov 13 23:34:05 user nova-compute[75307]: No targets found.
Nov 13 23:34:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:34:05 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:34:05 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1264946595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1264946595',id=39,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0irx37a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:33:54Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=3ea4d239-785b-4a80-9cfc-b8ac078c644f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d582c70-27fa-493b-9de8-204dffa15bde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:34:05 user nova-compute[75307]:   <uuid>3ea4d239-785b-4a80-9cfc-b8ac078c644f</uuid>
Nov 13 23:34:05 user nova-compute[75307]:   <name>instance-00000027</name>
Nov 13 23:34:05 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:34:05 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:34:05 user nova-compute[75307]:   <metadata>
Nov 13 23:34:05 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:34:05 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1264946595</nova:name>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:34:03</nova:creationTime>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:34:05 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:34:05 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:owner>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:34:05 user nova-compute[75307]:       </nova:owner>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:34:05 user nova-compute[75307]:       <nova:ports>
Nov 13 23:34:05 user nova-compute[75307]:         <nova:port uuid="02f43f2f-505a-4165-9510-37b6e163ed68">
Nov 13 23:34:05 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:34:05 user nova-compute[75307]:         </nova:port>
Nov 13 23:34:05 user nova-compute[75307]:       </nova:ports>
Nov 13 23:34:05 user nova-compute[75307]:     </nova:instance>
Nov 13 23:34:05 user nova-compute[75307]:   </metadata>
Nov 13 23:34:05 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:34:05 user nova-compute[75307]:     <system>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="serial">3ea4d239-785b-4a80-9cfc-b8ac078c644f</entry>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="uuid">3ea4d239-785b-4a80-9cfc-b8ac078c644f</entry>
Nov 13 23:34:05 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:34:05 user nova-compute[75307]:     </system>
Nov 13 23:34:05 user nova-compute[75307]:   </sysinfo>
Nov 13 23:34:05 user nova-compute[75307]:   <os>
Nov 13 23:34:05 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:34:05 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:34:05 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:34:05 user nova-compute[75307]:   </os>
Nov 13 23:34:05 user nova-compute[75307]:   <features>
Nov 13 23:34:05 user nova-compute[75307]:     <acpi/>
Nov 13 23:34:05 user nova-compute[75307]:     <apic/>
Nov 13 23:34:05 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:34:05 user nova-compute[75307]:   </features>
Nov 13 23:34:05 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:34:05 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:34:05 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:34:05 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:34:05 user nova-compute[75307]:   </clock>
Nov 13 23:34:05 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:34:05 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:34:05 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:34:05 user nova-compute[75307]:   </cpu>
Nov 13 23:34:05 user nova-compute[75307]:   <devices>
Nov 13 23:34:05 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:34:05 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:34:05 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:34:05 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:34:05 user nova-compute[75307]:       <serial>7c6b8aca-f813-403b-b862-fe1b48c62be7</serial>
Nov 13 23:34:05 user nova-compute[75307]:     </disk>
Nov 13 23:34:05 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:34:05 user nova-compute[75307]:       <mac address="fa:16:3e:99:81:37"/>
Nov 13 23:34:05 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:34:05 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:34:05 user nova-compute[75307]:       <target dev="tap02f43f2f-50"/>
Nov 13 23:34:05 user nova-compute[75307]:     </interface>
Nov 13 23:34:05 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:34:05 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/console.log" append="off"/>
Nov 13 23:34:05 user nova-compute[75307]:     </serial>
Nov 13 23:34:05 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:34:05 user nova-compute[75307]:     <video>
Nov 13 23:34:05 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:34:05 user nova-compute[75307]:     </video>
Nov 13 23:34:05 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:34:05 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:34:05 user nova-compute[75307]:     </rng>
Nov 13 23:34:05 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:34:05 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:34:05 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:34:05 user nova-compute[75307]:     </memballoon>
Nov 13 23:34:05 user nova-compute[75307]:   </devices>
Nov 13 23:34:05 user nova-compute[75307]: </domain>
Nov 13 23:34:05 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1264946595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1264946595',id=39,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0irx37a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:33:54Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=3ea4d239-785b-4a80-9cfc-b8ac078c644f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_vif [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a10841a7-cc02-5766-a287-d40950b5bebd', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d249e2-bbc4-4954-a530-81ba8672f588]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:05 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:05 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 (non-flash)
Nov 13 23:34:05 user nova-compute[75307]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:05 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c11ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02f43f2f-50, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02f43f2f-50, col_values=(('qos', UUID('460b750c-aeb5-4d98-b4b2-0c60e6940cae')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02f43f2f-50, col_values=(('external_ids', {'iface-id': '02f43f2f-505a-4165-9510-37b6e163ed68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:81:37', 'vm-uuid': '3ea4d239-785b-4a80-9cfc-b8ac078c644f'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:05 user nova-compute[75307]: INFO os_vif [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50')
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89867e7-abec-41cd-bd84-920b2cefd23d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb7ba4-c317-4231-a5d3-eb708ecee289]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e27d2f-c181-44e1-a4a2-310bd950d14c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:99:81:37, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d71987-7c73-4b05-bc6e-d6c0d2cbdd84]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b16195c-c44b-421c-a7c4-10301d31c183]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0d9519-a359-4c08-b8c8-e12920ea13ac]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260]
Nov 13 23:34:05 user nova-compute[75307]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469, portal: 172.16.0.220,3260] successful.
Nov 13 23:34:05 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7079823-4b44-4246-8353-803bf0966469 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a84cf25-076f-4c71-b339-0b93d68d5034]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== disconnect_volume: return (1087ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG nova.objects.instance [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-5f678bde-a5a7-4b1a-b508-a23aed4d20ce tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.576s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:06 user nova-compute[75307]: WARNING nova.compute.manager [req-ca1e76f5-95bd-4a63-8ed5-811feef19446 req-c82b5e19-dff3-4697-97ae-0fb422404ea3 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state building and task_state spawning.
Nov 13 23:34:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Going to confirm migration 2 {{(pid=75307) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:34:07 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'info_cache' on Instance uuid 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'migration_context' on Instance uuid 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Object Instance<4afb051a-6ad3-4d1b-b5f7-832ad997bd9c> lazy-loaded attributes: info_cache,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.312s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:08 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Deleted allocation for migration 4b20ccb0-3834-45c7-b9c6-ed2beec79e9d
Nov 13 23:34:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a3b10aa6-b913-4a41-9d39-e3b012a5bb74 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.193s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:34:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance spawned successfully.
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:34:08 user nova-compute[75307]: INFO nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 13 23:34:08 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:34:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:09 user nova-compute[75307]: WARNING nova.compute.manager [req-c83d4cb1-cf98-4567-9397-ec3aa078477a req-cb4c1860-b2d9-4f56-820a-0bd937c7e045 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state building and task_state spawning.
Nov 13 23:34:09 user nova-compute[75307]: INFO nova.compute.manager [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Took 15.42 seconds to build instance.
Nov 13 23:34:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1a69a099-57f4-4885-89fa-d73acbabd7df tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.513s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-changed-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Refreshing instance network info cache due to event network-changed-a9fe3361-15c7-409c-aec5-e5e511a86f2c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] Acquiring lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] Acquired lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:34:15 user nova-compute[75307]: DEBUG nova.network.neutron [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Refreshing network info cache for port a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Ignoring supplied device name: /dev/vdb
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:16 user nova-compute[75307]: INFO nova.compute.manager [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Attaching volume ce07290a-623e-41d0-9b33-1f6ef9116402 to /dev/vdb
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.utils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdef028f-205d-45d0-9d9c-15c6bd011966]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77a2ecd-c685-4159-bb1e-85ed57c46375]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc9507bb-866f-46fc-945d-a8248d187b72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce10698-0d1d-40d6-9bc2-8ce6e1f45622]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:34:16 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8576c46d-b397-411d-9b1f-483c868a7268]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG os_brick.utils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating existing volume attachment record: 205bb703-e335-4521-9622-674fe1fd61cc {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updated VIF entry in instance network info cache for port a9fe3361-15c7-409c-aec5-e5e511a86f2c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating instance_info_cache with network_info: [{"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-48a66172-999e-4331-9728-a6dd82164e06 req-6a3071ed-d68c-4db0-828f-2548033ea782 service nova] Releasing lock "refresh_cache-65130eff-823f-43cc-b861-02a9d5d4438e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:34:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:34:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:34:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:34:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating instance_info_cache with network_info: [{"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-02ac6279-f3bc-41df-89e0-493b7cdfa44e" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEpGxgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:20 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[acebb0ff-ee82-446d-83e0-786c4803127d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:34:20 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea29cb-db4c-41b8-a742-a18429708699]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402] added
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81183dd4-e13c-4582-adec-bb5868ca5978]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee71b375-3ce6-4c36-82fd-0ac4e4111146]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEpGxgq {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v maEpGxgq" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf255aa-d4cd-44bd-bcc8-7420bdc6e89c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'maEpGxgq'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ec8c2-9c4b-4f78-80c0-aa0cf4cf7a85]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d55964-3c55-4952-87b9-23f60c5e6aaa]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a5ed2-0c89-426c-802d-c8db20590ad3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260]
Nov 13 23:34:20 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260] successful.
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[085d3bae-dc8b-4217-b895-e514a44f162e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[16536e07-a3db-461e-9dbf-e750cb253e3f]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)
Nov 13 23:34:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ae381-3ea0-4826-8a1c-9594d833c4cb]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:34:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEpGxgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23465393334623133', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465393334623133', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:34:21 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:34:21 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:34:21 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:34:21 user nova-compute[75307]:   <serial>ce07290a-623e-41d0-9b33-1f6ef9116402</serial>
Nov 13 23:34:21 user nova-compute[75307]: </disk>
Nov 13 23:34:21 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No VIF found with MAC fa:16:3e:69:db:bd, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-aa022ab2-2dd5-44a9-a597-bc0a33d9b36e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.358s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:22 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:34:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8250MB free_disk=25.256725311279297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 81ca5221-bb7d-4587-999b-c772bfe99128 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 65130eff-823f-43cc-b861-02a9d5d4438e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:34:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:30 user nova-compute[75307]: INFO nova.compute.manager [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Detaching volume ce07290a-623e-41d0-9b33-1f6ef9116402
Nov 13 23:34:30 user nova-compute[75307]: INFO nova.virt.block_device [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Attempting to driver detach volume ce07290a-623e-41d0-9b33-1f6ef9116402 from mountpoint /dev/vdb
Nov 13 23:34:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Attempting to detach device vdb from instance 65130eff-823f-43cc-b861-02a9d5d4438e from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:34:30 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:34:30 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:34:30 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:34:30 user nova-compute[75307]:   <serial>ce07290a-623e-41d0-9b33-1f6ef9116402</serial>
Nov 13 23:34:30 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:34:30 user nova-compute[75307]: </disk>
Nov 13 23:34:30 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:34:30 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully detached device vdb from instance 65130eff-823f-43cc-b861-02a9d5d4438e from the persistent domain config.
Nov 13 23:34:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65130eff-823f-43cc-b861-02a9d5d4438e from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:34:30 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:34:30 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:34:30 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:34:30 user nova-compute[75307]:   <serial>ce07290a-623e-41d0-9b33-1f6ef9116402</serial>
Nov 13 23:34:30 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:34:30 user nova-compute[75307]: </disk>
Nov 13 23:34:30 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:34:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:34:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:34 user nova-compute[75307]: INFO nova.compute.manager [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Terminating instance
Nov 13 23:34:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-unplugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] No waiting events found dispatching network-vif-unplugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-1b83c2b6-e1f7-497c-8d3c-b20fa97de9b9 req-68eea073-eb61-46b3-81ac-706804b4d180 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-unplugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:34:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Instance destroyed successfully.
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'resources' on Instance uuid 02ac6279-f3bc-41df-89e0-493b7cdfa44e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:28:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-888115976',display_name='tempest-AttachVolumeNegativeTest-server-888115976',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-888115976',id=34,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFGbL+KVeoSfxMcj07zCYiA6Lck+hUQw2K2O0rO1iNbI2ynYtZgv43Fr5AaXeR8kGual4fXcwYETkXVOryl7/x9WazBwNUZMDdvpeIOQre+wDXfBn7Oe2OKvcM6949kiDg==',key_name='tempest-keypair-726424116',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:29:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-5k17edwt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:29:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=02ac6279-f3bc-41df-89e0-493b7cdfa44e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "address": "fa:16:3e:84:3c:96", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.184", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf89b9a3-90", "ovs_interfaceid": "df89b9a3-905a-49a7-9aca-dcdea83a9117", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG os_vif [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf89b9a3-90, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fa08c9a-42d7-4aaf-b809-ca73658a21a7) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:35 user nova-compute[75307]: INFO os_vif [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:84:3c:96,bridge_name='br-int',has_traffic_filtering=True,id=df89b9a3-905a-49a7-9aca-dcdea83a9117,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf89b9a3-90')
Nov 13 23:34:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Deleting instance files /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e_del
Nov 13 23:34:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Deletion of /opt/stack/data/nova/instances/02ac6279-f3bc-41df-89e0-493b7cdfa44e_del complete
Nov 13 23:34:35 user nova-compute[75307]: INFO nova.compute.manager [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 23:34:35 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:35 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Took 0.75 seconds to deallocate network for instance.
Nov 13 23:34:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-f929ec16-344d-4504-af1c-b9b59ca48574 req-c7ddef46-a3b7-4d36-bb7d-0c9c2700ffc3 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-deleted-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:36 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Deleted allocations for instance 02ac6279-f3bc-41df-89e0-493b7cdfa44e
Nov 13 23:34:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d7d6280b-83da-4789-b693-3de79ac3af6d tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] Acquiring lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] Lock "02ac6279-f3bc-41df-89e0-493b7cdfa44e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] No waiting events found dispatching network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:36 user nova-compute[75307]: WARNING nova.compute.manager [req-8b368d4f-31ac-4a37-bbb7-5b552680273b req-ac141c5f-8649-41f2-b8c7-27e8c0d2b990 service nova] [instance: 02ac6279-f3bc-41df-89e0-493b7cdfa44e] Received unexpected event network-vif-plugged-df89b9a3-905a-49a7-9aca-dcdea83a9117 for instance with vm_state deleted and task_state None.
Nov 13 23:34:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65130eff-823f-43cc-b861-02a9d5d4438e is timed out.
Nov 13 23:34:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully detached device vdb from instance 65130eff-823f-43cc-b861-02a9d5d4438e from the live domain config.
Nov 13 23:34:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEpGxgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:50 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[68cc0853-43dc-4d79-b7b6-7ea67216455a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:34:50 user nova-compute[75307]: No targets found.
Nov 13 23:34:50 user nova-compute[75307]: iSNS:
Nov 13 23:34:50 user nova-compute[75307]: No targets found.
Nov 13 23:34:50 user nova-compute[75307]: STATIC:
Nov 13 23:34:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:34:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:34:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:50 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402
Nov 13 23:34:50 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:50 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:50 user nova-compute[75307]: FIRMWARE:
Nov 13 23:34:50 user nova-compute[75307]: No targets found.
Nov 13 23:34:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:34:50 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:34:50 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ee5036-295d-4159-aaaa-c5c55bb02b30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a293a0da-2c41-44df-b80a-1547a30876b8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:50 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:50 user nova-compute[75307]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)
Nov 13 23:34:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:50 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:50 user nova-compute[75307]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 (non-flash)
Nov 13 23:34:50 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c2cf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[485e9e0a-daf8-4ccb-9cf2-76247126eab4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1547af9d-b192-4bdc-9dea-ce81bc4e59a9]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[36135927-8f57-4420-b87f-b0ec0567b803]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b880a78-690d-4b3b-b32e-4a133edaa367]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f5fea-ad94-4bca-9160-20cc29a446ac]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b4e9b9-bf2f-41ea-a2ff-11e096a8ba55]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260]
Nov 13 23:34:51 user nova-compute[75307]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402, portal: 172.16.0.220,3260] successful.
Nov 13 23:34:51 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc79ad7-5c17-4794-b284-838d2437fb9b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== disconnect_volume: return (310ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG nova.objects.instance [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-04724f64-71e2-44fc-b725-fd9a37180472 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.583s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.461s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:51 user nova-compute[75307]: INFO nova.compute.manager [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Terminating instance
Nov 13 23:34:51 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-unplugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] No waiting events found dispatching network-vif-unplugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-e34f5e99-a778-4a71-b0f5-47aa16554fe2 req-dca8daf7-8cf0-473b-a3b8-02bb9b4789ab service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-unplugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:34:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Instance destroyed successfully.
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'resources' on Instance uuid 65130eff-823f-43cc-b861-02a9d5d4438e {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:32:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1377208385',display_name='tempest-VolumesSnapshotTestJSON-instance-1377208385',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1377208385',id=38,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFqfBV/YWHa1mC8VcVu2AKAW3SU1WSjqdyIBNQYOKofPFjAiUqTvUmwgaIQ3nFJWaZ7otLhp9lSyJKTrcoU+9K+85ZH5t74BNuoWz61Kud4kaBjkvdFmzDHiQMew1lszsQ==',key_name='tempest-keypair-1570157988',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:32:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-u59ij9rp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:32:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=65130eff-823f-43cc-b861-02a9d5d4438e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "address": "fa:16:3e:69:db:bd", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa9fe3361-15", "ovs_interfaceid": "a9fe3361-15c7-409c-aec5-e5e511a86f2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_vif [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa9fe3361-15, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3eb1b94-7c65-4112-b788-bbf83557d215) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:34:52 user nova-compute[75307]: INFO os_vif [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:db:bd,bridge_name='br-int',has_traffic_filtering=True,id=a9fe3361-15c7-409c-aec5-e5e511a86f2c,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa9fe3361-15')
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'maEpGxgq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:34:52 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1a1f42-66ec-4df0-a145-d7748c1069b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:34:52 user nova-compute[75307]: No targets found.
Nov 13 23:34:52 user nova-compute[75307]: iSNS:
Nov 13 23:34:52 user nova-compute[75307]: No targets found.
Nov 13 23:34:52 user nova-compute[75307]: STATIC:
Nov 13 23:34:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:34:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:52 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:34:52 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:34:52 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:34:52 user nova-compute[75307]: FIRMWARE:
Nov 13 23:34:52 user nova-compute[75307]: No targets found.
Nov 13 23:34:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:34:52 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:34:52 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce07290a-623e-41d0-9b33-1f6ef9116402', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[406fe300-de15-4f48-8de2-907df4eca4b8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7707b46d-7bc7-4c12-b4f9-173ba8c06a62]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:52 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:34:52 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:34:52 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb342201f0>, {}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Disconnecting from: [] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== disconnect_volume: return (66ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:34:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Deleting instance files /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e_del
Nov 13 23:34:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Deletion of /opt/stack/data/nova/instances/65130eff-823f-43cc-b861-02a9d5d4438e_del complete
Nov 13 23:34:52 user nova-compute[75307]: INFO nova.compute.manager [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 23:34:52 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:34:52 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:53 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Took 0.68 seconds to deallocate network for instance.
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-7b8f8c94-044c-4dcc-ba79-e3c399e1d92a req-2c7869e8-dd27-4aff-9b35-deba9370e641 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-deleted-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:53 user nova-compute[75307]: INFO nova.compute.manager [req-7b8f8c94-044c-4dcc-ba79-e3c399e1d92a req-2c7869e8-dd27-4aff-9b35-deba9370e641 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Neutron deleted interface a9fe3361-15c7-409c-aec5-e5e511a86f2c; detaching it from the instance and deleting it from the info cache
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.network.neutron [req-7b8f8c94-044c-4dcc-ba79-e3c399e1d92a req-2c7869e8-dd27-4aff-9b35-deba9370e641 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:34:53 user nova-compute[75307]: WARNING nova.volume.cinder [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Attachment 205bb703-e335-4521-9622-674fe1fd61cc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 205bb703-e335-4521-9622-674fe1fd61cc. (HTTP 404) (Request-ID: req-6a922a4b-c7da-4feb-9782-6ca3ce373074)
Nov 13 23:34:53 user nova-compute[75307]: INFO nova.compute.manager [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Took 0.02 seconds to detach 1 volumes for instance.
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-7b8f8c94-044c-4dcc-ba79-e3c399e1d92a req-2c7869e8-dd27-4aff-9b35-deba9370e641 service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Detach interface failed, port_id=a9fe3361-15c7-409c-aec5-e5e511a86f2c, reason: Instance 65130eff-823f-43cc-b861-02a9d5d4438e could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:34:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:53 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Deleted allocations for instance 65130eff-823f-43cc-b861-02a9d5d4438e
Nov 13 23:34:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6c6d5c7e-bf53-46ca-9a2f-c70e1ae7384e tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "65130eff-823f-43cc-b861-02a9d5d4438e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.023s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:34:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] Acquiring lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:34:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:34:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] Lock "65130eff-823f-43cc-b861-02a9d5d4438e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:34:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] No waiting events found dispatching network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:34:54 user nova-compute[75307]: WARNING nova.compute.manager [req-614cfcd4-adb0-4790-9b86-c64e57d2e653 req-64845277-b0b5-4d3f-ac25-ff9ec437fecc service nova] [instance: 65130eff-823f-43cc-b861-02a9d5d4438e] Received unexpected event network-vif-plugged-a9fe3361-15c7-409c-aec5-e5e511a86f2c for instance with vm_state deleted and task_state None.
Nov 13 23:34:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:07 user nova-compute[75307]: INFO nova.compute.manager [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Terminating instance
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-unplugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] No waiting events found dispatching network-vif-unplugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-9c938489-f54a-4e3b-9014-6f3b54db1e3c req-52dd53ac-b408-4460-a0e4-605b791da32e service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-unplugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Instance destroyed successfully.
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lazy-loading 'resources' on Instance uuid 81ca5221-bb7d-4587-999b-c772bfe99128 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:26:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1695355740',display_name='tempest-ServersNegativeTestJSON-server-1695355740',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1695355740',id=31,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:26:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d367a26c5f3e408caeb0ffa8311f3d14',ramdisk_id='',reservation_id='r-t7bvsq2j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1320604312',owner_user_name='tempest-ServersNegativeTestJSON-1320604312-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:26:35Z,user_data=None,user_id='9f09950b58c343f8b8684ab68aeb6f97',uuid=81ca5221-bb7d-4587-999b-c772bfe99128,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converting VIF {"id": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "address": "fa:16:3e:48:6d:3c", "network": {"id": "7f103c1a-52b5-4b40-a885-12c98b58aa73", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1753230080-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d367a26c5f3e408caeb0ffa8311f3d14", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa2bd0ac5-e5", "ovs_interfaceid": "a2bd0ac5-e59e-477f-8d92-0f225b54b799", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG os_vif [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa2bd0ac5-e5, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c125a9e6-60c6-4836-b6ba-fa2bc6211ede) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:07 user nova-compute[75307]: INFO os_vif [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:6d:3c,bridge_name='br-int',has_traffic_filtering=True,id=a2bd0ac5-e59e-477f-8d92-0f225b54b799,network=Network(7f103c1a-52b5-4b40-a885-12c98b58aa73),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa2bd0ac5-e5')
Nov 13 23:35:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Deleting instance files /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128_del
Nov 13 23:35:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Deletion of /opt/stack/data/nova/instances/81ca5221-bb7d-4587-999b-c772bfe99128_del complete
Nov 13 23:35:08 user nova-compute[75307]: INFO nova.compute.manager [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 13 23:35:08 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:08 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Took 0.43 seconds to deallocate network for instance.
Nov 13 23:35:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:35:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:08 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Deleted allocations for instance 81ca5221-bb7d-4587-999b-c772bfe99128
Nov 13 23:35:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0bc9844b-0add-4141-9a77-f24ac3a805c0 tempest-ServersNegativeTestJSON-1320604312 tempest-ServersNegativeTestJSON-1320604312-project-member] Lock "81ca5221-bb7d-4587-999b-c772bfe99128" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.503s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] Acquiring lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] Lock "81ca5221-bb7d-4587-999b-c772bfe99128-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] No waiting events found dispatching network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:09 user nova-compute[75307]: WARNING nova.compute.manager [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received unexpected event network-vif-plugged-a2bd0ac5-e59e-477f-8d92-0f225b54b799 for instance with vm_state deleted and task_state None.
Nov 13 23:35:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-deb53572-ca5c-493a-86e4-18369b7537ce req-ca66dcfc-99f4-4454-891c-e505c5931477 service nova] [instance: 81ca5221-bb7d-4587-999b-c772bfe99128] Received event network-vif-deleted-a2bd0ac5-e59e-477f-8d92-0f225b54b799 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:11 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:35:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:35:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:35:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:35:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [{"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:35:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:24 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8561MB free_disk=25.33867645263672GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:35:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.699s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:35:28 user nova-compute[75307]: INFO nova.compute.claims [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Claim successful on node user
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:35:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.policy [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1bf68aa47d54db7b01286e246e2e655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048088f95c114110be9def433f1fd534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:35:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Creating image(s)
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:35:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:35:29 user nova-compute[75307]: INFO nova.compute.claims [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Claim successful on node user
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk 1073741824" returned: 0 in 0.048s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Successfully created port: c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:35:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Cannot resize image /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Ensure instance console log exists: /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.policy [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '76cc3bbf1a6a445d95ce63c5d7df7d8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc0c1d1aed13442eb606411efb5b14eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:35:29 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Creating image(s)
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "/opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "/opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "/opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.165s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.195s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk 1073741824" returned: 0 in 0.046s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Successfully updated port: c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquired lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Cannot resize image /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Ensure instance console log exists: /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-changed-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Refreshing instance network info cache due to event network-changed-c7043221-e6ef-41a1-8831-d025775ea342. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] Acquiring lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Successfully created port: 69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updating instance_info_cache with network_info: [{"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Releasing lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Instance network_info: |[{"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] Acquired lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Refreshing network info cache for port c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:35:30 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Start _get_guest_xml network_info=[{"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:35:31 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:31 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589864789',display_name='tempest-AttachVolumeNegativeTest-server-589864789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589864789',id=40,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUYDqiAIevC3mUukZ1KNmBCkaaTRT4P3A1yliYFIZX/0qb6rdq52wTSmA4aUtX3y9MycEPQquGBTDAApV/XIcv6ahmagaeLaSxymE2ekZIMGGsN7enGTbzHLsd/G5lmmw==',key_name='tempest-keypair-313772479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-7q04aaq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=bc8f7650-29be-4d1f-9dd9-435cc9ab36d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'pci_devices' on Instance uuid bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:35:31 user nova-compute[75307]:   <uuid>bc8f7650-29be-4d1f-9dd9-435cc9ab36d4</uuid>
Nov 13 23:35:31 user nova-compute[75307]:   <name>instance-00000028</name>
Nov 13 23:35:31 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:35:31 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:35:31 user nova-compute[75307]:   <metadata>
Nov 13 23:35:31 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:35:31 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeNegativeTest-server-589864789</nova:name>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:35:31</nova:creationTime>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:35:31 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:35:31 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:owner>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:user uuid="f1bf68aa47d54db7b01286e246e2e655">tempest-AttachVolumeNegativeTest-676261937-project-member</nova:user>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:project uuid="048088f95c114110be9def433f1fd534">tempest-AttachVolumeNegativeTest-676261937</nova:project>
Nov 13 23:35:31 user nova-compute[75307]:       </nova:owner>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:35:31 user nova-compute[75307]:       <nova:ports>
Nov 13 23:35:31 user nova-compute[75307]:         <nova:port uuid="c7043221-e6ef-41a1-8831-d025775ea342">
Nov 13 23:35:31 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 13 23:35:31 user nova-compute[75307]:         </nova:port>
Nov 13 23:35:31 user nova-compute[75307]:       </nova:ports>
Nov 13 23:35:31 user nova-compute[75307]:     </nova:instance>
Nov 13 23:35:31 user nova-compute[75307]:   </metadata>
Nov 13 23:35:31 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:35:31 user nova-compute[75307]:     <system>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="serial">bc8f7650-29be-4d1f-9dd9-435cc9ab36d4</entry>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="uuid">bc8f7650-29be-4d1f-9dd9-435cc9ab36d4</entry>
Nov 13 23:35:31 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:35:31 user nova-compute[75307]:     </system>
Nov 13 23:35:31 user nova-compute[75307]:   </sysinfo>
Nov 13 23:35:31 user nova-compute[75307]:   <os>
Nov 13 23:35:31 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:35:31 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:35:31 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:35:31 user nova-compute[75307]:   </os>
Nov 13 23:35:31 user nova-compute[75307]:   <features>
Nov 13 23:35:31 user nova-compute[75307]:     <acpi/>
Nov 13 23:35:31 user nova-compute[75307]:     <apic/>
Nov 13 23:35:31 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:35:31 user nova-compute[75307]:   </features>
Nov 13 23:35:31 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:35:31 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:35:31 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:35:31 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:35:31 user nova-compute[75307]:   </clock>
Nov 13 23:35:31 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:35:31 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:35:31 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:35:31 user nova-compute[75307]:   </cpu>
Nov 13 23:35:31 user nova-compute[75307]:   <devices>
Nov 13 23:35:31 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:35:31 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:35:31 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk"/>
Nov 13 23:35:31 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:35:31 user nova-compute[75307]:     </disk>
Nov 13 23:35:31 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:35:31 user nova-compute[75307]:       <mac address="fa:16:3e:cc:cf:ef"/>
Nov 13 23:35:31 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:31 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:35:31 user nova-compute[75307]:       <target dev="tapc7043221-e6"/>
Nov 13 23:35:31 user nova-compute[75307]:     </interface>
Nov 13 23:35:31 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:35:31 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/console.log" append="off"/>
Nov 13 23:35:31 user nova-compute[75307]:     </serial>
Nov 13 23:35:31 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:35:31 user nova-compute[75307]:     <video>
Nov 13 23:35:31 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:31 user nova-compute[75307]:     </video>
Nov 13 23:35:31 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:35:31 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:35:31 user nova-compute[75307]:     </rng>
Nov 13 23:35:31 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:35:31 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:35:31 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:35:31 user nova-compute[75307]:     </memballoon>
Nov 13 23:35:31 user nova-compute[75307]:   </devices>
Nov 13 23:35:31 user nova-compute[75307]: </domain>
Nov 13 23:35:31 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589864789',display_name='tempest-AttachVolumeNegativeTest-server-589864789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589864789',id=40,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUYDqiAIevC3mUukZ1KNmBCkaaTRT4P3A1yliYFIZX/0qb6rdq52wTSmA4aUtX3y9MycEPQquGBTDAApV/XIcv6ahmagaeLaSxymE2ekZIMGGsN7enGTbzHLsd/G5lmmw==',key_name='tempest-keypair-313772479',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-7q04aaq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:35:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=bc8f7650-29be-4d1f-9dd9-435cc9ab36d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG os_vif [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6b0f2e8a-291f-56bc-85c4-d099c164d41f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7043221-e6, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7043221-e6, col_values=(('qos', UUID('546d3580-d38b-4a4a-a313-81144f1fc64a')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7043221-e6, col_values=(('external_ids', {'iface-id': 'c7043221-e6ef-41a1-8831-d025775ea342', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:cf:ef', 'vm-uuid': 'bc8f7650-29be-4d1f-9dd9-435cc9ab36d4'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:31 user nova-compute[75307]: INFO os_vif [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6')
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:cc:cf:ef, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updated VIF entry in instance network info cache for port c7043221-e6ef-41a1-8831-d025775ea342. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updating instance_info_cache with network_info: [{"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8b06ce08-09df-4e72-891e-1040b7853743 req-57354c53-2d99-4a8a-bffe-eba49ac96835 service nova] Releasing lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Successfully updated port: 69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquired lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updating instance_info_cache with network_info: [{"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Releasing lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Instance network_info: |[{"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Start _get_guest_xml network_info=[{"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:35:31 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:31 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:35:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679850311',display_name='tempest-VolumesSnapshotTestJSON-instance-679850311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679850311',id=41,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIlZlL6wk0wPz4kQN01c1+5Mgy6GreBRLR/jkG6nLcJovy5wTLNqyPmJpt4nXmHmZGnPM2sAjpGF7ozs7z8/5w15WQYPySwKmQmzRSaOMxTyWpstPn/Mb5nnc2CzcoDGQ==',key_name='tempest-keypair-500444640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-wqja28n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=ffe099c1-5ba5-4325-9752-ddded75a71ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'pci_devices' on Instance uuid ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:35:32 user nova-compute[75307]:   <uuid>ffe099c1-5ba5-4325-9752-ddded75a71ef</uuid>
Nov 13 23:35:32 user nova-compute[75307]:   <name>instance-00000029</name>
Nov 13 23:35:32 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:35:32 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:35:32 user nova-compute[75307]:   <metadata>
Nov 13 23:35:32 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:35:32 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-679850311</nova:name>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:35:31</nova:creationTime>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:35:32 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:35:32 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:owner>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:user uuid="76cc3bbf1a6a445d95ce63c5d7df7d8d">tempest-VolumesSnapshotTestJSON-113181125-project-member</nova:user>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:project uuid="fc0c1d1aed13442eb606411efb5b14eb">tempest-VolumesSnapshotTestJSON-113181125</nova:project>
Nov 13 23:35:32 user nova-compute[75307]:       </nova:owner>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:35:32 user nova-compute[75307]:       <nova:ports>
Nov 13 23:35:32 user nova-compute[75307]:         <nova:port uuid="69879777-3ddf-4d72-b471-4156fc7b7931">
Nov 13 23:35:32 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:35:32 user nova-compute[75307]:         </nova:port>
Nov 13 23:35:32 user nova-compute[75307]:       </nova:ports>
Nov 13 23:35:32 user nova-compute[75307]:     </nova:instance>
Nov 13 23:35:32 user nova-compute[75307]:   </metadata>
Nov 13 23:35:32 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:35:32 user nova-compute[75307]:     <system>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="serial">ffe099c1-5ba5-4325-9752-ddded75a71ef</entry>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="uuid">ffe099c1-5ba5-4325-9752-ddded75a71ef</entry>
Nov 13 23:35:32 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:35:32 user nova-compute[75307]:     </system>
Nov 13 23:35:32 user nova-compute[75307]:   </sysinfo>
Nov 13 23:35:32 user nova-compute[75307]:   <os>
Nov 13 23:35:32 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:35:32 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:35:32 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:35:32 user nova-compute[75307]:   </os>
Nov 13 23:35:32 user nova-compute[75307]:   <features>
Nov 13 23:35:32 user nova-compute[75307]:     <acpi/>
Nov 13 23:35:32 user nova-compute[75307]:     <apic/>
Nov 13 23:35:32 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:35:32 user nova-compute[75307]:   </features>
Nov 13 23:35:32 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:35:32 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:35:32 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:35:32 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:35:32 user nova-compute[75307]:   </clock>
Nov 13 23:35:32 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:35:32 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:35:32 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:35:32 user nova-compute[75307]:   </cpu>
Nov 13 23:35:32 user nova-compute[75307]:   <devices>
Nov 13 23:35:32 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:35:32 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:35:32 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk"/>
Nov 13 23:35:32 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:35:32 user nova-compute[75307]:     </disk>
Nov 13 23:35:32 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:35:32 user nova-compute[75307]:       <mac address="fa:16:3e:51:ab:22"/>
Nov 13 23:35:32 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:32 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:35:32 user nova-compute[75307]:       <target dev="tap69879777-3d"/>
Nov 13 23:35:32 user nova-compute[75307]:     </interface>
Nov 13 23:35:32 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:35:32 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/console.log" append="off"/>
Nov 13 23:35:32 user nova-compute[75307]:     </serial>
Nov 13 23:35:32 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:35:32 user nova-compute[75307]:     <video>
Nov 13 23:35:32 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:32 user nova-compute[75307]:     </video>
Nov 13 23:35:32 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:35:32 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:35:32 user nova-compute[75307]:     </rng>
Nov 13 23:35:32 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:35:32 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:35:32 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:35:32 user nova-compute[75307]:     </memballoon>
Nov 13 23:35:32 user nova-compute[75307]:   </devices>
Nov 13 23:35:32 user nova-compute[75307]: </domain>
Nov 13 23:35:32 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679850311',display_name='tempest-VolumesSnapshotTestJSON-instance-679850311',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679850311',id=41,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIlZlL6wk0wPz4kQN01c1+5Mgy6GreBRLR/jkG6nLcJovy5wTLNqyPmJpt4nXmHmZGnPM2sAjpGF7ozs7z8/5w15WQYPySwKmQmzRSaOMxTyWpstPn/Mb5nnc2CzcoDGQ==',key_name='tempest-keypair-500444640',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-wqja28n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:35:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=ffe099c1-5ba5-4325-9752-ddded75a71ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG os_vif [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db3526c3-bcc6-553a-ab18-ced4755f078e', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap69879777-3d, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap69879777-3d, col_values=(('qos', UUID('e97342a9-de3d-4a7a-a929-266f452b09e6')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap69879777-3d, col_values=(('external_ids', {'iface-id': '69879777-3ddf-4d72-b471-4156fc7b7931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:ab:22', 'vm-uuid': 'ffe099c1-5ba5-4325-9752-ddded75a71ef'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: INFO os_vif [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d')
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No VIF found with MAC fa:16:3e:51:ab:22, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-changed-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Refreshing instance network info cache due to event network-changed-69879777-3ddf-4d72-b471-4156fc7b7931. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] Acquiring lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] Acquired lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Refreshing network info cache for port 69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG nova.network.neutron [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updated VIF entry in instance network info cache for port 69879777-3ddf-4d72-b471-4156fc7b7931. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG nova.network.neutron [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updating instance_info_cache with network_info: [{"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b89e1284-2cf6-4c96-934c-595c6b8efa87 req-b8bc1017-05ff-4f7f-a500-03e6573c9a1e service nova] Releasing lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] No waiting events found dispatching network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:34 user nova-compute[75307]: WARNING nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received unexpected event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 for instance with vm_state building and task_state spawning.
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] No waiting events found dispatching network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:34 user nova-compute[75307]: WARNING nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received unexpected event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 for instance with vm_state building and task_state spawning.
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] No waiting events found dispatching network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:34 user nova-compute[75307]: WARNING nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received unexpected event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 for instance with vm_state building and task_state spawning.
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] No waiting events found dispatching network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:34 user nova-compute[75307]: WARNING nova.compute.manager [req-ad543476-589d-41f2-aab7-80ccfe04d4f8 req-d937af03-a529-4051-9ed8-4614c8ada977 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received unexpected event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 for instance with vm_state building and task_state spawning.
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:35:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Instance spawned successfully.
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: INFO nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Took 7.13 seconds to spawn the instance on the hypervisor.
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:35:36 user nova-compute[75307]: INFO nova.compute.manager [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Took 7.75 seconds to build instance.
Nov 13 23:35:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-fb19d864-3994-411f-b151-67a03fe7fb3c tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.844s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:35:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Instance spawned successfully.
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:35:36 user nova-compute[75307]: INFO nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Took 6.73 seconds to spawn the instance on the hypervisor.
Nov 13 23:35:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:35:36 user nova-compute[75307]: INFO nova.compute.manager [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Took 7.57 seconds to build instance.
Nov 13 23:35:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ee945d99-fe4b-41b4-8e11-a5eabda454e9 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.679s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:44 user nova-compute[75307]: INFO nova.compute.manager [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Rescuing
Nov 13 23:35:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:35:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:35:44 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:35:44 user nova-compute[75307]: DEBUG nova.network.neutron [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:35:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:45 user nova-compute[75307]: WARNING nova.compute.manager [req-249b6b62-111f-4fef-93c2-2d177fb7de48 req-8467549e-2f10-442b-b365-6e3b02a1c838 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state active and task_state rescuing.
Nov 13 23:35:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance destroyed successfully.
Nov 13 23:35:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Attempting a stable device rescue
Nov 13 23:35:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:35:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Creating image(s)
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG nova.virt.images [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] d3d58686-c19c-4c13-99a7-1cd6c7a3ae91 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.part /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:47 user nova-compute[75307]: WARNING nova.compute.manager [req-2fcd5247-8bfd-4e91-aa1f-004c041a001b req-6f7a0acc-7a4e-4f48-9401-2c8f91d4c54c service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state active and task_state rescuing.
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.part /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.converted" returned: 0 in 0.337s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.830s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff --force-share --output=json" returned: 0 in 0.205s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff,backing_fmt=raw /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff,backing_fmt=raw /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue" returned: 0 in 0.046s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3f464d4e91a9ee0469c8e09abede15b5cfe2eeff" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'migration_context' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<3ea4d239-785b-4a80-9cfc-b8ac078c644f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start _get_guest_xml network_info=[{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:99:81:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd3d58686-c19c-4c13-99a7-1cd6c7a3ae91', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3ea4d239-785b-4a80-9cfc-b8ac078c644f', 'attached_at': '', 'detached_at': '', 'volume_id': '7c6b8aca-f813-403b-b862-fe1b48c62be7', 'serial': '7c6b8aca-f813-403b-b862-fe1b48c62be7'}, 'delete_on_termination': False, 'attachment_id': 'c68fcd6d-4407-4dc6-92b8-a545ae8833cf', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<3ea4d239-785b-4a80-9cfc-b8ac078c644f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'numa_topology' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<3ea4d239-785b-4a80-9cfc-b8ac078c644f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:35:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<3ea4d239-785b-4a80-9cfc-b8ac078c644f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:35:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:35:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:35:48 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf09d1de-703b-44dd-b46d-70c1ae99e72d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = rkvWcQsu\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 23:35:48 user nova-compute[75307]: node.name = iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:35:48 user nova-compute[75307]: node.tpgt = -1
Nov 13 23:35:48 user nova-compute[75307]: node.startup = automatic
Nov 13 23:35:48 user nova-compute[75307]: node.leading_login = No
Nov 13 23:35:48 user nova-compute[75307]: iface.iscsi_ifacename = default
Nov 13 23:35:48 user nova-compute[75307]: iface.net_ifacename = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.ipaddress = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.prefix_len = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.hwaddress = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.transport_name = tcp
Nov 13 23:35:48 user nova-compute[75307]: iface.initiatorname = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.vlan_id = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.vlan_priority = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.vlan_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.iface_num = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.mtu = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.port = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.bootproto = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.subnet_mask = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.gateway = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_alt_client_id = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_dns = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_learn_iqn = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_vendor_id_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_vendor_id = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.dhcp_slp_da = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.fragmentation = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.gratuitous_arp = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.incoming_forwarding = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.tos_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.tos = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.ttl = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.delayed_ack = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.tcp_nagle = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.tcp_wsf_state = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.tcp_wsf = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.tcp_timer_scale = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.tcp_timestamp = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.redirect = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.def_task_mgmt_timeout = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.header_digest = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.data_digest = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.immediate_data = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.initial_r2t = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.data_seq_inorder = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.data_pdu_inorder = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.erl = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.max_receive_data_len = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.first_burst_len = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.max_outstanding_r2t = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.max_burst_len = 0
Nov 13 23:35:48 user nova-compute[75307]: iface.chap_auth = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.bidi_chap = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.strict_login_compliance = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.discovery_auth = <empty>
Nov 13 23:35:48 user nova-compute[75307]: iface.discovery_logout = <empty>
Nov 13 23:35:48 user nova-compute[75307]: node.discovery_address = <empty>
Nov 13 23:35:48 user nova-compute[75307]: node.discovery_port = 0
Nov 13 23:35:48 user nova-compute[75307]: node.discovery_type = static
Nov 13 23:35:48 user nova-compute[75307]: node.session.initial_cmdsn = 0
Nov 13 23:35:48 user nova-compute[75307]: node.session.initial_login_retry_max = 8
Nov 13 23:35:48 user nova-compute[75307]: node.session.xmit_thread_priority = -20
Nov 13 23:35:48 user nova-compute[75307]: node.session.cmds_max = 128
Nov 13 23:35:48 user nova-compute[75307]: node.session.queue_depth = 32
Nov 13 23:35:48 user nova-compute[75307]: node.session.nr_sessions = 1
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.authmethod = CHAP
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.username = rkvWcQsu
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.password = ***
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.username_in = <empty>
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.password_in = <empty>
Nov 13 23:35:48 user nova-compute[75307]: node.session.auth.chap_algs = MD5
Nov 13 23:35:48 user nova-compute[75307]: node.session.timeo.replacement_timeout = 120
Nov 13 23:35:48 user nova-compute[75307]: node.session.err_timeo.abort_timeout = 15
Nov 13 23:35:48 user nova-compute[75307]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 23:35:48 user nova-compute[75307]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 23:35:48 user nova-compute[75307]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.FastAbort = Yes
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.InitialR2T = No
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.ImmediateData = Yes
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.MaxConnections = 1
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 23:35:48 user nova-compute[75307]: node.session.iscsi.ERL = 0
Nov 13 23:35:48 user nova-compute[75307]: node.session.scan = manual
Nov 13 23:35:48 user nova-compute[75307]: node.session.reopen_max = 0
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].address = 172.16.0.220
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].port = 3260
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].startup = manual
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].tcp.window_size = 524288
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].tcp.type_of_service = 0
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].timeo.logout_timeout = 15
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].timeo.login_timeout = 15
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].timeo.auth_timeout = 45
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.DataDigest = None
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.IFMarker = No
Nov 13 23:35:48 user nova-compute[75307]: node.conn[0].iscsi.OFMarker = No
Nov 13 23:35:48 user nova-compute[75307]: # END RECORD
Nov 13 23:35:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e6904d-a677-4749-9b4b-54ab06b7f429]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80f894c-590e-49ed-916d-eb9c0ee7326f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkvWcQsu {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rkvWcQsu" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3442cc81-5555-44f6-b85e-1900bf7b89a6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rkvWcQsu'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df588d69-1b8e-4bac-a1fb-c17be14ce6ab]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e163a2e1-40a2-455a-9534-85d9622bda61]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:35:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:35:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:35:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:35:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] HCTL ('35', '0', '0', 0) found on session 49 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[146a4944-3bc4-4ac8-b606-82d5d7e3b09d]: (4, ('0 0 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching for a device in session 49 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '26163376135336161', 'path': '/dev/sdd'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163376135336161', 'path': '/dev/sdd'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1264946595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1264946595',id=39,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:34:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0irx37a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:34:09Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=3ea4d239-785b-4a80-9cfc-b8ac078c644f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:99:81:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:99:81:37"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.objects.base [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<3ea4d239-785b-4a80-9cfc-b8ac078c644f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:35:48 user nova-compute[75307]:   <uuid>3ea4d239-785b-4a80-9cfc-b8ac078c644f</uuid>
Nov 13 23:35:48 user nova-compute[75307]:   <name>instance-00000027</name>
Nov 13 23:35:48 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:35:48 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:35:48 user nova-compute[75307]:   <metadata>
Nov 13 23:35:48 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:35:48 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1264946595</nova:name>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:35:48</nova:creationTime>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:35:48 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:35:48 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:owner>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:35:48 user nova-compute[75307]:       </nova:owner>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:35:48 user nova-compute[75307]:       <nova:ports>
Nov 13 23:35:48 user nova-compute[75307]:         <nova:port uuid="02f43f2f-505a-4165-9510-37b6e163ed68">
Nov 13 23:35:48 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 13 23:35:48 user nova-compute[75307]:         </nova:port>
Nov 13 23:35:48 user nova-compute[75307]:       </nova:ports>
Nov 13 23:35:48 user nova-compute[75307]:     </nova:instance>
Nov 13 23:35:48 user nova-compute[75307]:   </metadata>
Nov 13 23:35:48 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:35:48 user nova-compute[75307]:     <system>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="serial">3ea4d239-785b-4a80-9cfc-b8ac078c644f</entry>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="uuid">3ea4d239-785b-4a80-9cfc-b8ac078c644f</entry>
Nov 13 23:35:48 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:35:48 user nova-compute[75307]:     </system>
Nov 13 23:35:48 user nova-compute[75307]:   </sysinfo>
Nov 13 23:35:48 user nova-compute[75307]:   <os>
Nov 13 23:35:48 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:35:48 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:35:48 user nova-compute[75307]:   </os>
Nov 13 23:35:48 user nova-compute[75307]:   <features>
Nov 13 23:35:48 user nova-compute[75307]:     <acpi/>
Nov 13 23:35:48 user nova-compute[75307]:     <apic/>
Nov 13 23:35:48 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:35:48 user nova-compute[75307]:   </features>
Nov 13 23:35:48 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:35:48 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:35:48 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:35:48 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:35:48 user nova-compute[75307]:   </clock>
Nov 13 23:35:48 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:35:48 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:35:48 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:35:48 user nova-compute[75307]:   </cpu>
Nov 13 23:35:48 user nova-compute[75307]:   <devices>
Nov 13 23:35:48 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:35:48 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:35:48 user nova-compute[75307]:       <source dev="/dev/sdd"/>
Nov 13 23:35:48 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:35:48 user nova-compute[75307]:       <serial>7c6b8aca-f813-403b-b862-fe1b48c62be7</serial>
Nov 13 23:35:48 user nova-compute[75307]:     </disk>
Nov 13 23:35:48 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:35:48 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:35:48 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue"/>
Nov 13 23:35:48 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:35:48 user nova-compute[75307]:       <boot order="1"/>
Nov 13 23:35:48 user nova-compute[75307]:     </disk>
Nov 13 23:35:48 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:35:48 user nova-compute[75307]:       <mac address="fa:16:3e:99:81:37"/>
Nov 13 23:35:48 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:48 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:35:48 user nova-compute[75307]:       <target dev="tap02f43f2f-50"/>
Nov 13 23:35:48 user nova-compute[75307]:     </interface>
Nov 13 23:35:48 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:35:48 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/console.log" append="off"/>
Nov 13 23:35:48 user nova-compute[75307]:     </serial>
Nov 13 23:35:48 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:35:48 user nova-compute[75307]:     <video>
Nov 13 23:35:48 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:35:48 user nova-compute[75307]:     </video>
Nov 13 23:35:48 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:35:48 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:35:48 user nova-compute[75307]:     </rng>
Nov 13 23:35:48 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:35:48 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:35:48 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:35:48 user nova-compute[75307]:     </memballoon>
Nov 13 23:35:48 user nova-compute[75307]:   </devices>
Nov 13 23:35:48 user nova-compute[75307]: </domain>
Nov 13 23:35:48 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:35:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance destroyed successfully.
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:35:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:99:81:37, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:49 user nova-compute[75307]: WARNING nova.compute.manager [req-0202ba18-b7f0-4792-afea-6be16d812fab req-31c3fe66-4a5e-4060-a129-f2a4542d5355 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state active and task_state rescuing.
Nov 13 23:35:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d03002bf-775b-4c19-9a0b-bcf5df9dc65b tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:35:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:35:51 user nova-compute[75307]: WARNING nova.compute.manager [req-1fb925ca-d0df-438c-991e-841269217526 req-480fb7e2-795d-484b-983e-1881e988c6b4 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state active and task_state rescuing.
Nov 13 23:35:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:35:59 user nova-compute[75307]: INFO nova.compute.manager [None req-dea10434-ff4f-47e7-8c7d-08aad9ed6a3e tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Get console output
Nov 13 23:35:59 user nova-compute[75307]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 13 23:36:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:09 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:11 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:36:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:36:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:36:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:36:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:36:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:36:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:36:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:36:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:36:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:36:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=25.174274444580078GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ffe099c1-5ba5-4325-9752-ddded75a71ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:36:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:36:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:36:43 user nova-compute[75307]: INFO nova.compute.claims [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Claim successful on node user
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:36:43 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG nova.policy [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8cd34ad79490409d8a6ea1f82cb050a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5154ef16f778469aa278e00bd65c3881', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:36:43 user nova-compute[75307]: INFO nova.virt.block_device [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Booting with volume d8c9c117-e296-4d79-b405-5078614b841b at /dev/vda
Nov 13 23:36:43 user nova-compute[75307]: DEBUG os_brick.utils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[02547b05-d325-4214-a27a-e765e8ffe911]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dd9325-d92a-4417-8a9c-34fb7af08014]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cbd58d-5245-4bbe-b2be-363b858c8020]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdd664f-81c9-4d06-a7b6-0df8e9955f8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:36:44 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:36:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3169df8e-1853-4614-9a18-6c0fd5cc8365]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG os_brick.utils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating existing volume attachment record: 35affb02-2280-48be-ace4-f6a4df71b71c {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:36:44 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Successfully created port: f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Successfully updated port: f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing instance network info cache due to event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance network_info: |[{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updated VIF entry in instance network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG nova.network.neutron [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:36:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c9cfdcb1-3487-4d54-9a36-46464fbb6ec4 req-80443280-7a48-40cb-95a7-900d8ecb7777 service nova] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:36:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:36:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Creating image(s)
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Ensure instance console log exists: /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start _get_guest_xml network_info=[{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8c9c117-e296-4d79-b405-5078614b841b', 'serial': 'd8c9c117-e296-4d79-b405-5078614b841b'}, 'delete_on_termination': True, 'attachment_id': '35affb02-2280-48be-ace4-f6a4df71b71c', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:36:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:36:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:36:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:36:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:36:48 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d27bec-c820-407c-88af-6bc38d7611e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:36:48 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd118410-fe3e-4cec-83f0-77190838dcaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b] added
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bed30-9b5b-4b3f-8294-101b53855341]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c729f5b0-34db-4a4e-b65b-770a1a917392]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuafmCwL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuafmCwL" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a233e19-cc93-4fd0-84d8-3bd4d3779ab7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuafmCwL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ffe5b-90d1-4343-9b03-ebdd0c23e262]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e208153-0d2f-48e3-a4b8-6271338787a4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[49272f3a-45df-4f79-a54f-7c5ec6b13ccf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]
Nov 13 23:36:48 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e59628f-0816-4176-ad11-ee063e4cea95]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e8a13c-e862-49f0-9f95-e2883dd58fb7]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:36:48 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:36:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb77f102-6d06-4ca0-90d1-b5be8a02c63e]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:36:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23165653461663939', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165653461663939', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOaPLmOg3yofJinacuU5A7ZEXFuHQOe/bnovkupNhbpe7OofVVKAnYUGoff8Fk4DQyysdqdXYyLlBHX8dso6Xdc1KIFj2Ms9EoGiyRah40lGQ6cYC+xuMmS88gd2LofQ==',key_name='tempest-TestShelveInstance-1508157924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:36:44Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.objects.instance [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:36:49 user nova-compute[75307]:   <uuid>8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</uuid>
Nov 13 23:36:49 user nova-compute[75307]:   <name>instance-0000002a</name>
Nov 13 23:36:49 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:36:49 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:36:49 user nova-compute[75307]:   <metadata>
Nov 13 23:36:49 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:36:49 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:36:49 user nova-compute[75307]:       <nova:name>tempest-TestShelveInstance-server-603910968</nova:name>
Nov 13 23:36:49 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:36:48</nova:creationTime>
Nov 13 23:36:49 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:36:49 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:36:49 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:36:49 user nova-compute[75307]:       <nova:owner>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:user uuid="8cd34ad79490409d8a6ea1f82cb050a2">tempest-TestShelveInstance-1952798290-project-member</nova:user>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:project uuid="5154ef16f778469aa278e00bd65c3881">tempest-TestShelveInstance-1952798290</nova:project>
Nov 13 23:36:49 user nova-compute[75307]:       </nova:owner>
Nov 13 23:36:49 user nova-compute[75307]:       <nova:ports>
Nov 13 23:36:49 user nova-compute[75307]:         <nova:port uuid="f770263d-357f-4d15-95f4-d4f8a10fd808">
Nov 13 23:36:49 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 23:36:49 user nova-compute[75307]:         </nova:port>
Nov 13 23:36:49 user nova-compute[75307]:       </nova:ports>
Nov 13 23:36:49 user nova-compute[75307]:     </nova:instance>
Nov 13 23:36:49 user nova-compute[75307]:   </metadata>
Nov 13 23:36:49 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:36:49 user nova-compute[75307]:     <system>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="serial">8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</entry>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="uuid">8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</entry>
Nov 13 23:36:49 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:36:49 user nova-compute[75307]:     </system>
Nov 13 23:36:49 user nova-compute[75307]:   </sysinfo>
Nov 13 23:36:49 user nova-compute[75307]:   <os>
Nov 13 23:36:49 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:36:49 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:36:49 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:36:49 user nova-compute[75307]:   </os>
Nov 13 23:36:49 user nova-compute[75307]:   <features>
Nov 13 23:36:49 user nova-compute[75307]:     <acpi/>
Nov 13 23:36:49 user nova-compute[75307]:     <apic/>
Nov 13 23:36:49 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:36:49 user nova-compute[75307]:   </features>
Nov 13 23:36:49 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:36:49 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:36:49 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:36:49 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:36:49 user nova-compute[75307]:   </clock>
Nov 13 23:36:49 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:36:49 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:36:49 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:36:49 user nova-compute[75307]:   </cpu>
Nov 13 23:36:49 user nova-compute[75307]:   <devices>
Nov 13 23:36:49 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:36:49 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:36:49 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:36:49 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:36:49 user nova-compute[75307]:       <serial>d8c9c117-e296-4d79-b405-5078614b841b</serial>
Nov 13 23:36:49 user nova-compute[75307]:     </disk>
Nov 13 23:36:49 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:36:49 user nova-compute[75307]:       <mac address="fa:16:3e:3d:ee:bd"/>
Nov 13 23:36:49 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:36:49 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:36:49 user nova-compute[75307]:       <target dev="tapf770263d-35"/>
Nov 13 23:36:49 user nova-compute[75307]:     </interface>
Nov 13 23:36:49 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:36:49 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac/console.log" append="off"/>
Nov 13 23:36:49 user nova-compute[75307]:     </serial>
Nov 13 23:36:49 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:36:49 user nova-compute[75307]:     <video>
Nov 13 23:36:49 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:36:49 user nova-compute[75307]:     </video>
Nov 13 23:36:49 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:36:49 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:36:49 user nova-compute[75307]:     </rng>
Nov 13 23:36:49 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:36:49 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:36:49 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:36:49 user nova-compute[75307]:     </memballoon>
Nov 13 23:36:49 user nova-compute[75307]:   </devices>
Nov 13 23:36:49 user nova-compute[75307]: </domain>
Nov 13 23:36:49 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOaPLmOg3yofJinacuU5A7ZEXFuHQOe/bnovkupNhbpe7OofVVKAnYUGoff8Fk4DQyysdqdXYyLlBHX8dso6Xdc1KIFj2Ms9EoGiyRah40lGQ6cYC+xuMmS88gd2LofQ==',key_name='tempest-TestShelveInstance-1508157924',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:36:44Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG os_vif [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e6a00b1-9bf7-5996-be60-7909543c1e87', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf770263d-35, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf770263d-35, col_values=(('qos', UUID('8b3963bd-c680-4420-ad6c-e243d65c9001')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf770263d-35, col_values=(('external_ids', {'iface-id': 'f770263d-357f-4d15-95f4-d4f8a10fd808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:ee:bd', 'vm-uuid': '8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:49 user nova-compute[75307]: INFO os_vif [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35')
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:36:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] No VIF found with MAC fa:16:3e:3d:ee:bd, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:36:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:36:51 user nova-compute[75307]: WARNING nova.compute.manager [req-9e76bf1a-5f87-4c09-a479-ce38b23dc38e req-da5c35c2-0a85-42f0-a103-2ebf7468d9d7 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state building and task_state spawning.
Nov 13 23:36:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:36:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance spawned successfully.
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:36:53 user nova-compute[75307]: WARNING nova.compute.manager [req-e6562cde-f1fa-4129-a205-fb36a48ab472 req-0cf0532c-bb36-4964-97ed-736d39c2ce72 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state building and task_state spawning.
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:36:53 user nova-compute[75307]: INFO nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 13 23:36:53 user nova-compute[75307]: DEBUG nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:36:53 user nova-compute[75307]: INFO nova.compute.manager [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Took 10.18 seconds to build instance.
Nov 13 23:36:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-725f8ad5-a249-40e4-825b-efb142c3d58e tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.284s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:36:59 user nova-compute[75307]: INFO nova.compute.manager [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Terminating instance
Nov 13 23:36:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:36:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-d5bea34f-ff2f-41a6-965c-3b094ec06249 req-3ee09991-5a86-4239-8f2e-24a4dea2cb9d service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Instance destroyed successfully.
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'resources' on Instance uuid 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1777366366',display_name='tempest-ServerActionsTestOtherA-server-1777366366',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1777366366',id=35,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:32:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-wyldgdn9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:34:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=4afb051a-6ad3-4d1b-b5f7-832ad997bd9c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "address": "fa:16:3e:91:44:9a", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3cb8024-52", "ovs_interfaceid": "f3cb8024-52d1-42b1-81b5-1f5eee8e079c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_vif [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3cb8024-52, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2a7e1c12-8f8d-4f3e-bcca-4346cd547411) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: INFO os_vif [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:44:9a,bridge_name='br-int',has_traffic_filtering=True,id=f3cb8024-52d1-42b1-81b5-1f5eee8e079c,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3cb8024-52')
Nov 13 23:37:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TenGdtEF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:00 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a02646d-8924-4c3e-8152-8e2dd524e3d2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:37:00 user nova-compute[75307]: No targets found.
Nov 13 23:37:00 user nova-compute[75307]: iSNS:
Nov 13 23:37:00 user nova-compute[75307]: No targets found.
Nov 13 23:37:00 user nova-compute[75307]: STATIC:
Nov 13 23:37:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:37:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a
Nov 13 23:37:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:00 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:37:00 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:00 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:00 user nova-compute[75307]: FIRMWARE:
Nov 13 23:37:00 user nova-compute[75307]: No targets found.
Nov 13 23:37:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:37:00 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:37:00 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5325d081-496e-4b35-a57b-b913301c9dcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[36428574-71f2-4149-9d9e-9b7056f113d8]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:37:00 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:00 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a (non-flash)
Nov 13 23:37:00 user nova-compute[75307]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:00 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:00 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c163130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6f143a-c410-4bb6-81f7-5c0760ab40c3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[492fd445-98ee-4cc3-87b4-a784f050e500]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9555baf-f8ac-49bd-9cb6-c4a3e82a5036]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.074s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd40da7-26f6-4e51-b26b-0b7f676686c1]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOf0e20e2e-f7a358ac95bd45a4', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f0e20e2e', '/dev/disk/by-id/scsi-26637613335386163') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06b739-0509-4d76-9e4a-be0fdaf1eaf3]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[839bc48b-3fed-4a91-8057-2e22c7f6035c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:00 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5b3c1c-e07c-4389-830d-846b5da25923]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260]
Nov 13 23:37:01 user nova-compute[75307]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a, portal: 172.16.0.220,3260] successful.
Nov 13 23:37:01 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe89a298-e459-4821-b0fd-c5cfa0e4047a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee757e2c-f7f1-421a-9aff-7320dabbd9ff]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] <== disconnect_volume: return (372ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:37:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Deleting instance files /opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c_del
Nov 13 23:37:01 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Deletion of /opt/stack/data/nova/instances/4afb051a-6ad3-4d1b-b5f7-832ad997bd9c_del complete
Nov 13 23:37:01 user nova-compute[75307]: INFO nova.compute.manager [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 13 23:37:01 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:02 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Took 0.86 seconds to deallocate network for instance.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:02 user nova-compute[75307]: WARNING nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state deleting.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:02 user nova-compute[75307]: WARNING nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state deleting.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:02 user nova-compute[75307]: WARNING nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state deleting.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-unplugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Acquiring lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] No waiting events found dispatching network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:02 user nova-compute[75307]: WARNING nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received unexpected event network-vif-plugged-f3cb8024-52d1-42b1-81b5-1f5eee8e079c for instance with vm_state active and task_state deleting.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-f0e06d6e-1a71-468b-b109-9d835d478b82 req-c15269af-f4ca-4146-8a48-ac0a595b08bd service nova] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Received event network-vif-deleted-f3cb8024-52d1-42b1-81b5-1f5eee8e079c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:02 user nova-compute[75307]: INFO nova.compute.manager [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Took 0.70 seconds to detach 1 volumes for instance.
Nov 13 23:37:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c] Deleting volume: fe89a298-e459-4821-b0fd-c5cfa0e4047a {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:03 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:37:03 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:37:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:03 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Deleted allocations for instance 4afb051a-6ad3-4d1b-b5f7-832ad997bd9c
Nov 13 23:37:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-92e65626-7842-491f-b4d7-c5f01a1ab207 tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "4afb051a-6ad3-4d1b-b5f7-832ad997bd9c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:12 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-changed-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Refreshing instance network info cache due to event network-changed-c7043221-e6ef-41a1-8831-d025775ea342. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] Acquiring lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] Acquired lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Refreshing network info cache for port c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updated VIF entry in instance network info cache for port c7043221-e6ef-41a1-8831-d025775ea342. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updating instance_info_cache with network_info: [{"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8edc8d1e-4a7f-4b02-94ff-6cee0f8460dc req-7432ca27-84d3-4ebd-91af-d9ec91528c89 service nova] Releasing lock "refresh_cache-bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-changed-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Refreshing instance network info cache due to event network-changed-69879777-3ddf-4d72-b471-4156fc7b7931. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] Acquiring lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] Acquired lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:37:19 user nova-compute[75307]: DEBUG nova.network.neutron [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Refreshing network info cache for port 69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updated VIF entry in instance network info cache for port 69879777-3ddf-4d72-b471-4156fc7b7931. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updating instance_info_cache with network_info: [{"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c765ac2d-2d10-416c-8f06-c22713d63904 req-422185af-8d27-4c50-8dbb-bb77ba2acdde service nova] Releasing lock "refresh_cache-ffe099c1-5ba5-4325-9752-ddded75a71ef" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:21 user nova-compute[75307]: INFO nova.compute.manager [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Attaching volume 68804bf7-8888-41f8-83d7-a6b340af8697 to /dev/vdb
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aff581-ed95-47ec-a277-f391234ecc65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ae07ac-6a4a-4ffd-8f3a-388230de5b77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1d1fe7-b5b9-419e-96c1-3ccaa53042e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6ff43d-47b9-45a8-b35d-a2ec398e9e4d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:37:21 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7492c74-0196-4793-8c22-6fcd809d640d]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updating existing volume attachment record: efb84c96-a8ba-45f0-9dc9-9902e22accc8 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Ignoring supplied device name: /dev/vdb
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:21 user nova-compute[75307]: INFO nova.compute.manager [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Attaching volume 981c18b1-35a5-4b8d-8070-5b33fef10ad0 to /dev/vdb
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d762de-6348-4230-8851-780a2cd64eab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46258520-2c73-41ac-87f7-83a5b4116a77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e3816b-f3b3-4960-9f4d-e709f6be2e87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e5343b-89c3-4947-a605-1a7db98366a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:37:21 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:37:21 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0aea77-cbfd-451a-ad75-7e545a8918ed]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG os_brick.utils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:21 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updating existing volume attachment record: bbc8f373-18dc-40c9-98e8-d6db69464f8d {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:37:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcUAiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:25 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c983f9f-b352-4365-9cea-f54b78de2490]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:37:25 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50159cb-d2b0-4526-9a66-60f62d97a704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697] added
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[99517771-e75b-42f5-b08d-cb834512a3d6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb24b2d-5aaa-4002-9e1e-e15cca48c46b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXcUAiPr {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXcUAiPr" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[23818935-63e8-4848-9d55-43188ecfce74]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXcUAiPr'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e24b947-0440-4c46-b69a-a2cd147d07dd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[be56b60f-7a1f-4583-8672-471905b1291b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6503c8ce-0847-435a-a70a-fa58c6260f04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260]
Nov 13 23:37:25 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260] successful.
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[07078e87-a04b-47bb-b1da-7873ce4f08ce]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18d1a83-76ff-4722-84de-8f37da3babdb]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:25 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:25 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60af08-b8ed-4c8e-8a2e-60990abcae75]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcUAiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXmhzygK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:25 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:25 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:25 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23530636366613830', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530636366613830', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.942s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:26 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:26 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG nova.objects.instance [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8753347-e51b-459c-adf3-b2f8c2859ba6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:37:26 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:37:26 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:26 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:37:26 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:26 user nova-compute[75307]:   <serial>68804bf7-8888-41f8-83d7-a6b340af8697</serial>
Nov 13 23:37:26 user nova-compute[75307]: </disk>
Nov 13 23:37:26 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[013c3c2c-38e4-421f-9f61-41ae21ce2c22]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0] added
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d8aac-6d8a-49de-8181-4ab3df054562]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[de200a91-281f-41da-aa17-c432e28b9e35]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXmhzygK {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXmhzygK" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe56d5fd-4bfb-406a-b2fd-03749f0ed5b8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXmhzygK'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f73093bd-0020-4f87-9cca-6e544b31debe]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8dc559-8fe8-42b9-aae7-1f03ec05e36c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c393e0f-f525-4554-83a9-97133817f54f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260]
Nov 13 23:37:26 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260] successful.
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92dd4fa-35a3-4997-879f-6d049df47cee]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[196403ee-c78d-4dea-82d0-bf1f10d94945]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:26 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] HCTL ('36', '-', '-', 0) found on session 53 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[299aba92-cf90-41d7-bf9b-704fa03e9a16]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Searching for a device in session 53 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXmhzygK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:37:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:cc:cf:ef, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-ddd70bf3-e4ee-4407-aac4-e3493bb03327 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.141s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== connect_volume: return (2395ms) {'type': 'block', 'scsi_wwn': '23866623733366161', 'path': '/dev/sde'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866623733366161', 'path': '/dev/sde'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:37:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:37:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8185MB free_disk=25.17031478881836GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:28 user nova-compute[75307]: INFO nova.compute.manager [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Detaching volume 68804bf7-8888-41f8-83d7-a6b340af8697
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:37:28 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:28 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:37:28 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:28 user nova-compute[75307]:   <serial>981c18b1-35a5-4b8d-8070-5b33fef10ad0</serial>
Nov 13 23:37:28 user nova-compute[75307]: </disk>
Nov 13 23:37:28 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:37:28 user nova-compute[75307]: INFO nova.virt.block_device [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Attempting to driver detach volume 68804bf7-8888-41f8-83d7-a6b340af8697 from mountpoint /dev/vdb
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8bf8a928-35cc-413a-b7e8-5afeecb20924 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance ffe099c1-5ba5-4325-9752-ddded75a71ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Attempting to detach device vdb from instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:37:28 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:28 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:37:28 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:28 user nova-compute[75307]:   <serial>68804bf7-8888-41f8-83d7-a6b340af8697</serial>
Nov 13 23:37:28 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:37:28 user nova-compute[75307]: </disk>
Nov 13 23:37:28 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:37:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 from the persistent domain config.
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:37:28 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:28 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 13 23:37:28 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:28 user nova-compute[75307]:   <serial>68804bf7-8888-41f8-83d7-a6b340af8697</serial>
Nov 13 23:37:28 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:37:28 user nova-compute[75307]: </disk>
Nov 13 23:37:28 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] No VIF found with MAC fa:16:3e:51:ab:22, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:37:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-a6cb2416-2356-43f5-a791-73e194ff1d05 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.250s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:35 user nova-compute[75307]: INFO nova.compute.manager [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Unrescuing
Nov 13 23:37:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'flavor' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:36 user nova-compute[75307]: INFO nova.compute.manager [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Detaching volume 981c18b1-35a5-4b8d-8070-5b33fef10ad0
Nov 13 23:37:36 user nova-compute[75307]: INFO nova.virt.block_device [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Attempting to driver detach volume 981c18b1-35a5-4b8d-8070-5b33fef10ad0 from mountpoint /dev/vdb
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:36 user nova-compute[75307]: WARNING nova.compute.manager [req-1e496a4e-16c4-4b57-858e-748b5768c729 req-6d06871f-c860-4080-8c04-ae6a71e84c34 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Attempting to detach device vdb from instance ffe099c1-5ba5-4325-9752-ddded75a71ef from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:37:36 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:36 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:37:36 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:36 user nova-compute[75307]:   <serial>981c18b1-35a5-4b8d-8070-5b33fef10ad0</serial>
Nov 13 23:37:36 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:37:36 user nova-compute[75307]: </disk>
Nov 13 23:37:36 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:37:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully detached device vdb from instance ffe099c1-5ba5-4325-9752-ddded75a71ef from the persistent domain config.
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ffe099c1-5ba5-4325-9752-ddded75a71ef from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:37:36 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:37:36 user nova-compute[75307]:   <source dev="/dev/sde"/>
Nov 13 23:37:36 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:37:36 user nova-compute[75307]:   <serial>981c18b1-35a5-4b8d-8070-5b33fef10ad0</serial>
Nov 13 23:37:36 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:37:36 user nova-compute[75307]: </disk>
Nov 13 23:37:36 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:37:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance destroyed successfully.
Nov 13 23:37:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:38 user nova-compute[75307]: WARNING nova.compute.manager [req-0d2d306b-f142-4613-94e5-56a26b5f5d31 req-83673a5d-fcce-455d-8687-97aded404ce5 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:37:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:40 user nova-compute[75307]: WARNING nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:37:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:40 user nova-compute[75307]: WARNING nova.compute.manager [req-dfbb5c14-0647-42c2-8721-f9211f22f365 req-9199dbe0-cb58-4e73-b712-43c1d5e1b75a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:37:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-645c10d1-19fa-4eda-b3c6-7277e1b0a036 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:37:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:48 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 is timed out.
Nov 13 23:37:48 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 from the live domain config.
Nov 13 23:37:48 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXcUAiPr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:48 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a7bd56-5056-442a-bcd5-042fb1409627]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:37:48 user nova-compute[75307]: No targets found.
Nov 13 23:37:48 user nova-compute[75307]: iSNS:
Nov 13 23:37:48 user nova-compute[75307]: No targets found.
Nov 13 23:37:48 user nova-compute[75307]: STATIC:
Nov 13 23:37:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:37:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0
Nov 13 23:37:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:37:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:48 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697
Nov 13 23:37:48 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:48 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:48 user nova-compute[75307]: FIRMWARE:
Nov 13 23:37:48 user nova-compute[75307]: No targets found.
Nov 13 23:37:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:37:48 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:37:48 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f57a2b6-c0fe-43bd-a089-63f218fababa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8258f39c-b43b-41d3-bd37-0ef7e19bdf3d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34354040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074886e-cc7d-4ba7-af02-7c115173ea88]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c598d564-2656-4390-a1f8-7b54ab8becc6]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d73e2b-b3e1-4235-9ba5-c0d1d66c0250]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4314eb-b859-42d5-86d2-ec380757910c]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0ff09-94ba-42b6-8a22-44dd3c001ae6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2bc1f-4d7d-4e56-badc-991334f3bfb3]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260]
Nov 13 23:37:48 user nova-compute[75307]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697, portal: 172.16.0.220,3260] successful.
Nov 13 23:37:48 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:68804bf7-8888-41f8-83d7-a6b340af8697 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a58695-e471-423a-8350-2545b8c92d93]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== disconnect_volume: return (318ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e74e3e8d-83c4-4498-8538-fb0f5d89bab5 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.740s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:52 user nova-compute[75307]: INFO nova.compute.manager [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Terminating instance
Nov 13 23:37:52 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-unplugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] No waiting events found dispatching network-vif-unplugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:52 user nova-compute[75307]: DEBUG nova.compute.manager [req-0abbcf13-d83c-494c-b93b-9b0cfd844f5a req-958b2210-f413-414f-8a57-5fb123e9609b service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-unplugged-872b038e-7eab-4644-bf2b-11a948011758 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:37:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Instance destroyed successfully.
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.objects.instance [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lazy-loading 'resources' on Instance uuid 8bf8a928-35cc-413a-b7e8-5afeecb20924 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:19:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-56780046',display_name='tempest-ServerActionsTestOtherA-server-56780046',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-56780046',id=18,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpzsnfHfglZNdxZjeahmBZJemUBGca6e13eW4wAe27uohcF3csdWlarnS2VaHXL7aTu2YKC7KE3EOT1iyH9uoLNec2ztjWmxyc3wi/BqoZes+b/EbQjnAKD6nBxf5qnCw==',key_name='tempest-keypair-1091771333',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:19:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f4260b68885d4f5ebfa01306bf64a9b9',ramdisk_id='',reservation_id='r-17hxeb27',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-708902499',owner_user_name='tempest-ServerActionsTestOtherA-708902499-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:19:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7b605f62d134435896eb5dce0b48d51c',uuid=8bf8a928-35cc-413a-b7e8-5afeecb20924,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converting VIF {"id": "872b038e-7eab-4644-bf2b-11a948011758", "address": "fa:16:3e:cc:6b:e9", "network": {"id": "7bda0a7d-4201-462a-9391-302dfdf67f5d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-507396201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f4260b68885d4f5ebfa01306bf64a9b9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap872b038e-7e", "ovs_interfaceid": "872b038e-7eab-4644-bf2b-11a948011758", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG os_vif [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap872b038e-7e, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed9e6bc2-2352-4b05-87e9-a3bf329c1172) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:37:53 user nova-compute[75307]: INFO os_vif [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:6b:e9,bridge_name='br-int',has_traffic_filtering=True,id=872b038e-7eab-4644-bf2b-11a948011758,network=Network(7bda0a7d-4201-462a-9391-302dfdf67f5d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap872b038e-7e')
Nov 13 23:37:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Deleting instance files /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924_del
Nov 13 23:37:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Deletion of /opt/stack/data/nova/instances/8bf8a928-35cc-413a-b7e8-5afeecb20924_del complete
Nov 13 23:37:53 user nova-compute[75307]: INFO nova.compute.manager [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 13 23:37:53 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:53 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Took 0.41 seconds to deallocate network for instance.
Nov 13 23:37:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:54 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Deleted allocations for instance 8bf8a928-35cc-413a-b7e8-5afeecb20924
Nov 13 23:37:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2887fb6e-6fac-4058-a01c-e7cad33c00aa tempest-ServerActionsTestOtherA-708902499 tempest-ServerActionsTestOtherA-708902499-project-member] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.508s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] Acquiring lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] Lock "8bf8a928-35cc-413a-b7e8-5afeecb20924-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] No waiting events found dispatching network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:54 user nova-compute[75307]: WARNING nova.compute.manager [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received unexpected event network-vif-plugged-872b038e-7eab-4644-bf2b-11a948011758 for instance with vm_state deleted and task_state None.
Nov 13 23:37:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-2f5f82d0-79ad-4742-9641-0e91c2aa9934 req-6ee2cc25-b6e9-4c7e-ae33-d032a7c4ee7d service nova] [instance: 8bf8a928-35cc-413a-b7e8-5afeecb20924] Received event network-vif-deleted-872b038e-7eab-4644-bf2b-11a948011758 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:56 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ffe099c1-5ba5-4325-9752-ddded75a71ef is timed out.
Nov 13 23:37:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully detached device vdb from instance ffe099c1-5ba5-4325-9752-ddded75a71ef from the live domain config.
Nov 13 23:37:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:37:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXmhzygK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:56 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:56 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:56 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c73e9b3-fe8a-459b-b29c-ea84a1677577]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:37:57 user nova-compute[75307]: No targets found.
Nov 13 23:37:57 user nova-compute[75307]: iSNS:
Nov 13 23:37:57 user nova-compute[75307]: No targets found.
Nov 13 23:37:57 user nova-compute[75307]: STATIC:
Nov 13 23:37:57 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:37:57 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:57 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:57 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0
Nov 13 23:37:57 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:57 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:57 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:37:57 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:57 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:57 user nova-compute[75307]: FIRMWARE:
Nov 13 23:37:57 user nova-compute[75307]: No targets found.
Nov 13 23:37:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:37:57 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:37:57 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28129b3-f4bc-494c-a335-034c71f52766]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea022cc7-aa69-4c36-a06f-7113d9606576]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:57 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:57 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:57 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:57 user nova-compute[75307]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 (non-flash)
Nov 13 23:37:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34776cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0'): ({'sde'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Removing single pathed devices sde {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[137f5b8a-eb1b-46c9-b57e-a7a3627294be]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d05401b-3cf9-4e65-81a4-c01817a49e27]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Flushing IO for device /dev/sde {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c60581-f7a5-4451-9a04-4c904b42f961]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.038s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9190814a-793d-42d3-a588-504c5931c388]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] SCSI volumes sde have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fe675-8368-4827-8cd9-30049e798b52]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[613788fc-7947-445d-812a-4fa4e5e61dd1]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260]
Nov 13 23:37:57 user nova-compute[75307]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0, portal: 172.16.0.220,3260] successful.
Nov 13 23:37:57 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e34b62-5529-4f6e-9e77-9a529a8730b9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.274s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== disconnect_volume: return (276ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:37:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'flavor' on Instance uuid ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4c301d9b-ff7a-4487-8c91-d18792efe8af tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.813s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:58 user nova-compute[75307]: INFO nova.compute.manager [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Terminating instance
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-unplugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] No waiting events found dispatching network-vif-unplugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.compute.manager [req-e93e794b-7fef-4c61-81b0-7a1c85702f73 req-8428d949-d825-4cf8-a382-7173069c5cac service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-unplugged-69879777-3ddf-4d72-b471-4156fc7b7931 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Instance destroyed successfully.
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.objects.instance [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lazy-loading 'resources' on Instance uuid ffe099c1-5ba5-4325-9752-ddded75a71ef {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679850311',display_name='tempest-VolumesSnapshotTestJSON-instance-679850311',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679850311',id=41,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMIlZlL6wk0wPz4kQN01c1+5Mgy6GreBRLR/jkG6nLcJovy5wTLNqyPmJpt4nXmHmZGnPM2sAjpGF7ozs7z8/5w15WQYPySwKmQmzRSaOMxTyWpstPn/Mb5nnc2CzcoDGQ==',key_name='tempest-keypair-500444640',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fc0c1d1aed13442eb606411efb5b14eb',ramdisk_id='',reservation_id='r-wqja28n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-113181125',owner_user_name='tempest-VolumesSnapshotTestJSON-113181125-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:35:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='76cc3bbf1a6a445d95ce63c5d7df7d8d',uuid=ffe099c1-5ba5-4325-9752-ddded75a71ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converting VIF {"id": "69879777-3ddf-4d72-b471-4156fc7b7931", "address": "fa:16:3e:51:ab:22", "network": {"id": "dfe3bdd1-d304-474e-889c-13e4e0c081f7", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1198717285-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fc0c1d1aed13442eb606411efb5b14eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap69879777-3d", "ovs_interfaceid": "69879777-3ddf-4d72-b471-4156fc7b7931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_vif [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap69879777-3d, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e97342a9-de3d-4a7a-a929-266f452b09e6) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:37:58 user nova-compute[75307]: INFO os_vif [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:ab:22,bridge_name='br-int',has_traffic_filtering=True,id=69879777-3ddf-4d72-b471-4156fc7b7931,network=Network(dfe3bdd1-d304-474e-889c-13e4e0c081f7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap69879777-3d')
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXmhzygK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:37:58 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5166ac7a-0548-4b97-b293-02240a5a9d5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:37:58 user nova-compute[75307]: No targets found.
Nov 13 23:37:58 user nova-compute[75307]: iSNS:
Nov 13 23:37:58 user nova-compute[75307]: No targets found.
Nov 13 23:37:58 user nova-compute[75307]: STATIC:
Nov 13 23:37:58 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:37:58 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:58 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:58 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:37:58 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:37:58 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:37:58 user nova-compute[75307]: FIRMWARE:
Nov 13 23:37:58 user nova-compute[75307]: No targets found.
Nov 13 23:37:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:37:58 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:37:58 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:981c18b1-35a5-4b8d-8070-5b33fef10ad0', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a0cd4e-ebb6-44b8-87d5-35ddf883de7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc53fdda-5072-436a-ac20-0d4bf4fec037]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:58 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:37:58 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:37:58 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34230d30>, {}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Disconnecting from: [] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.064s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] <== disconnect_volume: return (65ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:37:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Deleting instance files /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef_del
Nov 13 23:37:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Deletion of /opt/stack/data/nova/instances/ffe099c1-5ba5-4325-9752-ddded75a71ef_del complete
Nov 13 23:37:58 user nova-compute[75307]: INFO nova.compute.manager [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 23:37:58 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:37:58 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:37:59 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:37:59 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Took 0.62 seconds to deallocate network for instance.
Nov 13 23:37:59 user nova-compute[75307]: WARNING nova.volume.cinder [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Attachment bbc8f373-18dc-40c9-98e8-d6db69464f8d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = bbc8f373-18dc-40c9-98e8-d6db69464f8d. (HTTP 404) (Request-ID: req-ee15a895-3864-4e39-b5af-b1c1d441cd7b)
Nov 13 23:37:59 user nova-compute[75307]: INFO nova.compute.manager [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Took 0.02 seconds to detach 1 volumes for instance.
Nov 13 23:37:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:37:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:37:59 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:37:59 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:37:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.189s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:37:59 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Deleted allocations for instance ffe099c1-5ba5-4325-9752-ddded75a71ef
Nov 13 23:37:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-16a57390-a72b-4723-b1a5-d3c03b52bf15 tempest-VolumesSnapshotTestJSON-113181125 tempest-VolumesSnapshotTestJSON-113181125-project-member] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] Acquiring lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] Lock "ffe099c1-5ba5-4325-9752-ddded75a71ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] No waiting events found dispatching network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:38:00 user nova-compute[75307]: WARNING nova.compute.manager [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received unexpected event network-vif-plugged-69879777-3ddf-4d72-b471-4156fc7b7931 for instance with vm_state deleted and task_state None.
Nov 13 23:38:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-64bb4fec-a6d9-40c3-8d16-b0a50ebb4991 req-ed602288-f73e-4887-84ea-caee72574945 service nova] [instance: ffe099c1-5ba5-4325-9752-ddded75a71ef] Received event network-vif-deleted-69879777-3ddf-4d72-b471-4156fc7b7931 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:38:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:14 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:18 user nova-compute[75307]: INFO nova.compute.manager [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Terminating instance
Nov 13 23:38:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-unplugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] No waiting events found dispatching network-vif-unplugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-86233de3-d546-4844-b1e1-2f2f03494c80 req-13926338-c153-4c74-a320-394a8754adc9 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-unplugged-c7043221-e6ef-41a1-8831-d025775ea342 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:38:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Instance destroyed successfully.
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.objects.instance [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'resources' on Instance uuid bc8f7650-29be-4d1f-9dd9-435cc9ab36d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:35:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-589864789',display_name='tempest-AttachVolumeNegativeTest-server-589864789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-589864789',id=40,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGUYDqiAIevC3mUukZ1KNmBCkaaTRT4P3A1yliYFIZX/0qb6rdq52wTSmA4aUtX3y9MycEPQquGBTDAApV/XIcv6ahmagaeLaSxymE2ekZIMGGsN7enGTbzHLsd/G5lmmw==',key_name='tempest-keypair-313772479',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:35:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-7q04aaq2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:35:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=bc8f7650-29be-4d1f-9dd9-435cc9ab36d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "c7043221-e6ef-41a1-8831-d025775ea342", "address": "fa:16:3e:cc:cf:ef", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.118", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7043221-e6", "ovs_interfaceid": "c7043221-e6ef-41a1-8831-d025775ea342", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG os_vif [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7043221-e6, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=546d3580-d38b-4a4a-a313-81144f1fc64a) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:19 user nova-compute[75307]: INFO os_vif [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:cf:ef,bridge_name='br-int',has_traffic_filtering=True,id=c7043221-e6ef-41a1-8831-d025775ea342,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7043221-e6')
Nov 13 23:38:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Deleting instance files /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4_del
Nov 13 23:38:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Deletion of /opt/stack/data/nova/instances/bc8f7650-29be-4d1f-9dd9-435cc9ab36d4_del complete
Nov 13 23:38:19 user nova-compute[75307]: INFO nova.compute.manager [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 13 23:38:19 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:20 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Took 0.88 seconds to deallocate network for instance.
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.226s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:20 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Deleted allocations for instance bc8f7650-29be-4d1f-9dd9-435cc9ab36d4
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-3ef741b3-c000-4569-81f8-4fab889bd033 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.304s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] Acquiring lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] Lock "bc8f7650-29be-4d1f-9dd9-435cc9ab36d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] No waiting events found dispatching network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:38:20 user nova-compute[75307]: WARNING nova.compute.manager [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received unexpected event network-vif-plugged-c7043221-e6ef-41a1-8831-d025775ea342 for instance with vm_state deleted and task_state None.
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-2075ae4d-ed48-42db-bc92-6f5fad54c6d0 req-cf7e072a-74b0-452b-be8a-82b4fc4fcc48 service nova] [instance: bc8f7650-29be-4d1f-9dd9-435cc9ab36d4] Received event network-vif-deleted-c7043221-e6ef-41a1-8831-d025775ea342 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:38:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:38:21 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:38:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:38:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:38:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8675MB free_disk=25.253238677978516GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:38:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:38:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG nova.compute.manager [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing instance network info cache due to event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:34 user nova-compute[75307]: DEBUG nova.network.neutron [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG nova.network.neutron [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updated VIF entry in instance network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG nova.network.neutron [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65417e26-e7b0-48cd-bb92-f2f1599ecd81 req-4323ad41-1cd2-4396-8ac6-b252950ab1d4 service nova] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:35 user nova-compute[75307]: INFO nova.compute.manager [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Shelve offloading
Nov 13 23:38:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:38:35 user nova-compute[75307]: WARNING nova.compute.manager [req-477e4b59-78fa-47d8-bc33-8712b5d18241 req-278e41ca-5b7e-4a67-82a7-8c2c076ef802 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state active and task_state shelving.
Nov 13 23:38:36 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance destroyed successfully.
Nov 13 23:38:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:38:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:38:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance destroyed successfully.
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'resources' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOaPLmOg3yofJinacuU5A7ZEXFuHQOe/bnovkupNhbpe7OofVVKAnYUGoff8Fk4DQyysdqdXYyLlBHX8dso6Xdc1KIFj2Ms9EoGiyRah40lGQ6cYC+xuMmS88gd2LofQ==',key_name='tempest-TestShelveInstance-1508157924',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:36:53Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_vif [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf770263d-35, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8b3963bd-c680-4420-ad6c-e243d65c9001) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing instance network info cache due to event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:38:37 user nova-compute[75307]: INFO os_vif [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35')
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:38:37 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[488ff7e7-39c0-45ef-83bb-e45878cca9f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:38:37 user nova-compute[75307]: No targets found.
Nov 13 23:38:37 user nova-compute[75307]: iSNS:
Nov 13 23:38:37 user nova-compute[75307]: No targets found.
Nov 13 23:38:37 user nova-compute[75307]: STATIC:
Nov 13 23:38:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:38:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:38:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:38:37 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:38:37 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:38:37 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:38:37 user nova-compute[75307]: FIRMWARE:
Nov 13 23:38:37 user nova-compute[75307]: No targets found.
Nov 13 23:38:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:38:37 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:38:37 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf71c38-f12d-4af7-b128-5b8d659ebff1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fe134d-6280-4e67-a7ce-422c2508bd1b]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:38:37 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:38:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:38:37 user nova-compute[75307]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:38:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34776f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccd5e9-8bd3-4471-99dd-57b2d076e9f5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44f65bf-bc3e-48b1-81cd-a9d42315aa78]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[290209ef-fc3b-451a-a109-f6ba87f45181]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6f0bc2-4688-46cc-ac18-bd34fcae7482]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc72d60d-eca0-4ba4-9f16-c1c897c95c8a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b31589-a7ae-402b-acad-84651c7dee1c]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]
Nov 13 23:38:37 user nova-compute[75307]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.
Nov 13 23:38:37 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95cfdc9-9cd6-4b05-80ef-65e3ee058af4]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== disconnect_volume: return (295ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:38:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deleting instance files /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac_del
Nov 13 23:38:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deletion of /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac_del complete
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updated VIF entry in instance network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.network.neutron [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": null, "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapf770263d-35", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-32600b03-6d1d-4eec-a1e9-c1c56b6fa50d req-8013cf01-d48f-4a5f-bc6e-e976b62b6392 service nova] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:38:37 user nova-compute[75307]: WARNING nova.compute.manager [req-cc3f650b-ae58-4ac2-9bfc-928653cc4260 req-ae22ec14-bb14-491f-8ae7-c7ed52d7b5dc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state active and task_state shelving.
Nov 13 23:38:39 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Deleted allocations for instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac
Nov 13 23:38:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG nova.objects.base [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Object Instance<8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac> lazy-loaded attributes: resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b0e3e832-40e1-4024-ba50-10dbd883a599 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.751s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:38:57 user nova-compute[75307]: INFO nova.compute.claims [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Claim successful on node user
Nov 13 23:38:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:38:57 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:38:57 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.policy [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2709ea16f7b6424a9c67107096249c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267b7151e414c9180bc7c8e5accd6de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:38:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Creating image(s)
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk 1073741824" returned: 0 in 0.052s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Successfully created port: febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.200s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Cannot resize image /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Ensure instance console log exists: /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:38:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Successfully updated port: febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing instance network info cache due to event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance network_info: |[{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start _get_guest_xml network_info=[{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:38:59 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:38:59 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5B94VWw6po+HawKe7jlIH8Bz4MjMGA1B0hFH+wk7kgvCn5zvf9xqxXYLRkvA4VPQRMKxa5RchxvrtusS7ZvJy35P+TLjgGn/ZRa82yJ/IVjtUqW3As4iZm49q1YN2KNg==',key_name='tempest-keypair-140235525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_devices' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:38:59 user nova-compute[75307]:   <uuid>76cf692b-48a2-4db6-8d81-7c82a2678fad</uuid>
Nov 13 23:38:59 user nova-compute[75307]:   <name>instance-0000002b</name>
Nov 13 23:38:59 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:38:59 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:38:59 user nova-compute[75307]:   <metadata>
Nov 13 23:38:59 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:38:59 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-614165099</nova:name>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:38:59</nova:creationTime>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:38:59 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:38:59 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:owner>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:user uuid="2709ea16f7b6424a9c67107096249c3e">tempest-AttachVolumeShelveTestJSON-620800295-project-member</nova:user>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:project uuid="b267b7151e414c9180bc7c8e5accd6de">tempest-AttachVolumeShelveTestJSON-620800295</nova:project>
Nov 13 23:38:59 user nova-compute[75307]:       </nova:owner>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:38:59 user nova-compute[75307]:       <nova:ports>
Nov 13 23:38:59 user nova-compute[75307]:         <nova:port uuid="febdd6d8-9bb4-4d70-80c6-880c48e5db09">
Nov 13 23:38:59 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:38:59 user nova-compute[75307]:         </nova:port>
Nov 13 23:38:59 user nova-compute[75307]:       </nova:ports>
Nov 13 23:38:59 user nova-compute[75307]:     </nova:instance>
Nov 13 23:38:59 user nova-compute[75307]:   </metadata>
Nov 13 23:38:59 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:38:59 user nova-compute[75307]:     <system>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="serial">76cf692b-48a2-4db6-8d81-7c82a2678fad</entry>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="uuid">76cf692b-48a2-4db6-8d81-7c82a2678fad</entry>
Nov 13 23:38:59 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:38:59 user nova-compute[75307]:     </system>
Nov 13 23:38:59 user nova-compute[75307]:   </sysinfo>
Nov 13 23:38:59 user nova-compute[75307]:   <os>
Nov 13 23:38:59 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:38:59 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:38:59 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:38:59 user nova-compute[75307]:   </os>
Nov 13 23:38:59 user nova-compute[75307]:   <features>
Nov 13 23:38:59 user nova-compute[75307]:     <acpi/>
Nov 13 23:38:59 user nova-compute[75307]:     <apic/>
Nov 13 23:38:59 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:38:59 user nova-compute[75307]:   </features>
Nov 13 23:38:59 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:38:59 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:38:59 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:38:59 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:38:59 user nova-compute[75307]:   </clock>
Nov 13 23:38:59 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:38:59 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:38:59 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:38:59 user nova-compute[75307]:   </cpu>
Nov 13 23:38:59 user nova-compute[75307]:   <devices>
Nov 13 23:38:59 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:38:59 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:38:59 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk"/>
Nov 13 23:38:59 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:38:59 user nova-compute[75307]:     </disk>
Nov 13 23:38:59 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:38:59 user nova-compute[75307]:       <mac address="fa:16:3e:1e:21:e4"/>
Nov 13 23:38:59 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:38:59 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:38:59 user nova-compute[75307]:       <target dev="tapfebdd6d8-9b"/>
Nov 13 23:38:59 user nova-compute[75307]:     </interface>
Nov 13 23:38:59 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:38:59 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/console.log" append="off"/>
Nov 13 23:38:59 user nova-compute[75307]:     </serial>
Nov 13 23:38:59 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:38:59 user nova-compute[75307]:     <video>
Nov 13 23:38:59 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:38:59 user nova-compute[75307]:     </video>
Nov 13 23:38:59 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:38:59 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:38:59 user nova-compute[75307]:     </rng>
Nov 13 23:38:59 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:38:59 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:38:59 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:38:59 user nova-compute[75307]:     </memballoon>
Nov 13 23:38:59 user nova-compute[75307]:   </devices>
Nov 13 23:38:59 user nova-compute[75307]: </domain>
Nov 13 23:38:59 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5B94VWw6po+HawKe7jlIH8Bz4MjMGA1B0hFH+wk7kgvCn5zvf9xqxXYLRkvA4VPQRMKxa5RchxvrtusS7ZvJy35P+TLjgGn/ZRa82yJ/IVjtUqW3As4iZm49q1YN2KNg==',key_name='tempest-keypair-140235525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:38:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG os_vif [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429fabff-1274-5534-8e20-c467e58104ca', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebdd6d8-9b, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfebdd6d8-9b, col_values=(('qos', UUID('dabdffff-5730-4f13-b8b6-f6082295b5d8')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfebdd6d8-9b, col_values=(('external_ids', {'iface-id': 'febdd6d8-9bb4-4d70-80c6-880c48e5db09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:21:e4', 'vm-uuid': '76cf692b-48a2-4db6-8d81-7c82a2678fad'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:38:59 user nova-compute[75307]: INFO os_vif [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b')
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No VIF found with MAC fa:16:3e:1e:21:e4, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updated VIF entry in instance network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG nova.network.neutron [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:38:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-632eb849-7c41-414c-95d4-1eede661ab3a req-6d47ab63-4b7c-441e-94e9-4a746b866824 service nova] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:01 user nova-compute[75307]: WARNING nova.compute.manager [req-18299a02-3234-42d8-ba99-5ac96722ff6b req-0e6e7326-8e01-4d26-8008-2ed001ade028 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state building and task_state spawning.
Nov 13 23:39:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:39:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance spawned successfully.
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:03 user nova-compute[75307]: INFO nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Took 4.97 seconds to spawn the instance on the hypervisor.
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:39:03 user nova-compute[75307]: INFO nova.compute.manager [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Took 5.54 seconds to build instance.
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:03 user nova-compute[75307]: WARNING nova.compute.manager [req-c8d896dd-b655-46e2-bbeb-c9274fe18892 req-360d5f98-bca7-48b1-847f-f993360ef44e service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state active and task_state None.
Nov 13 23:39:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4fcfa711-5c08-4460-9085-c25ea2111c13 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.686s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:11 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:39:11 user nova-compute[75307]: INFO nova.compute.claims [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Claim successful on node user
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:39:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:39:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Creating image(s)
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "/opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "/opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG nova.policy [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1bf68aa47d54db7b01286e246e2e655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '048088f95c114110be9def433f1fd534', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.187s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk 1073741824" returned: 0 in 0.046s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Successfully created port: 1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Cannot resize image /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Ensure instance console log exists: /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Successfully updated port: 1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquired lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-changed-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Refreshing instance network info cache due to event network-changed-1fc6a47d-fc59-41d9-9753-7e6590b9074e. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] Acquiring lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:39:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updating instance_info_cache with network_info: [{"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Releasing lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Instance network_info: |[{"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] Acquired lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Refreshing network info cache for port 1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Start _get_guest_xml network_info=[{"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:39:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1314012456',display_name='tempest-AttachVolumeNegativeTest-server-1314012456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1314012456',id=44,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDb3Q8Z0DYLnHEHuAv2GEEC3THuoodaBjr7imD31gzzCcpTeonzzms0Fnov6qM+c6D7Op8oishqjynUJAKsFSHSdSYfE4CRcp7aCRrKAp/iCbOHnZZe7sqFyn6OqaS8pw==',key_name='tempest-keypair-1375224651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-0q9huntn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=f5b2b706-4a67-4df5-b0ba-0ec813578b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'pci_devices' on Instance uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:39:14 user nova-compute[75307]:   <uuid>f5b2b706-4a67-4df5-b0ba-0ec813578b9b</uuid>
Nov 13 23:39:14 user nova-compute[75307]:   <name>instance-0000002c</name>
Nov 13 23:39:14 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:39:14 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:39:14 user nova-compute[75307]:   <metadata>
Nov 13 23:39:14 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:39:14 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1314012456</nova:name>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:39:14</nova:creationTime>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:39:14 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:39:14 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:owner>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:user uuid="f1bf68aa47d54db7b01286e246e2e655">tempest-AttachVolumeNegativeTest-676261937-project-member</nova:user>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:project uuid="048088f95c114110be9def433f1fd534">tempest-AttachVolumeNegativeTest-676261937</nova:project>
Nov 13 23:39:14 user nova-compute[75307]:       </nova:owner>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:39:14 user nova-compute[75307]:       <nova:ports>
Nov 13 23:39:14 user nova-compute[75307]:         <nova:port uuid="1fc6a47d-fc59-41d9-9753-7e6590b9074e">
Nov 13 23:39:14 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:39:14 user nova-compute[75307]:         </nova:port>
Nov 13 23:39:14 user nova-compute[75307]:       </nova:ports>
Nov 13 23:39:14 user nova-compute[75307]:     </nova:instance>
Nov 13 23:39:14 user nova-compute[75307]:   </metadata>
Nov 13 23:39:14 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:39:14 user nova-compute[75307]:     <system>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="serial">f5b2b706-4a67-4df5-b0ba-0ec813578b9b</entry>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="uuid">f5b2b706-4a67-4df5-b0ba-0ec813578b9b</entry>
Nov 13 23:39:14 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:39:14 user nova-compute[75307]:     </system>
Nov 13 23:39:14 user nova-compute[75307]:   </sysinfo>
Nov 13 23:39:14 user nova-compute[75307]:   <os>
Nov 13 23:39:14 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:39:14 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:39:14 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:39:14 user nova-compute[75307]:   </os>
Nov 13 23:39:14 user nova-compute[75307]:   <features>
Nov 13 23:39:14 user nova-compute[75307]:     <acpi/>
Nov 13 23:39:14 user nova-compute[75307]:     <apic/>
Nov 13 23:39:14 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:39:14 user nova-compute[75307]:   </features>
Nov 13 23:39:14 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:39:14 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:39:14 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:39:14 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:39:14 user nova-compute[75307]:   </clock>
Nov 13 23:39:14 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:39:14 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:39:14 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:39:14 user nova-compute[75307]:   </cpu>
Nov 13 23:39:14 user nova-compute[75307]:   <devices>
Nov 13 23:39:14 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:39:14 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:39:14 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk"/>
Nov 13 23:39:14 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:39:14 user nova-compute[75307]:     </disk>
Nov 13 23:39:14 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:39:14 user nova-compute[75307]:       <mac address="fa:16:3e:f9:86:72"/>
Nov 13 23:39:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:39:14 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:39:14 user nova-compute[75307]:       <target dev="tap1fc6a47d-fc"/>
Nov 13 23:39:14 user nova-compute[75307]:     </interface>
Nov 13 23:39:14 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:39:14 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/console.log" append="off"/>
Nov 13 23:39:14 user nova-compute[75307]:     </serial>
Nov 13 23:39:14 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:39:14 user nova-compute[75307]:     <video>
Nov 13 23:39:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:39:14 user nova-compute[75307]:     </video>
Nov 13 23:39:14 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:39:14 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:39:14 user nova-compute[75307]:     </rng>
Nov 13 23:39:14 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:39:14 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:39:14 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:39:14 user nova-compute[75307]:     </memballoon>
Nov 13 23:39:14 user nova-compute[75307]:   </devices>
Nov 13 23:39:14 user nova-compute[75307]: </domain>
Nov 13 23:39:14 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1314012456',display_name='tempest-AttachVolumeNegativeTest-server-1314012456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1314012456',id=44,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDb3Q8Z0DYLnHEHuAv2GEEC3THuoodaBjr7imD31gzzCcpTeonzzms0Fnov6qM+c6D7Op8oishqjynUJAKsFSHSdSYfE4CRcp7aCRrKAp/iCbOHnZZe7sqFyn6OqaS8pw==',key_name='tempest-keypair-1375224651',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-0q9huntn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:39:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=f5b2b706-4a67-4df5-b0ba-0ec813578b9b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG os_vif [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fab14c12-bc39-5f43-a517-7e86d271beb7', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1fc6a47d-fc, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1fc6a47d-fc, col_values=(('qos', UUID('ed003ed0-7372-4e39-ba2c-ae3c4b7ea298')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1fc6a47d-fc, col_values=(('external_ids', {'iface-id': '1fc6a47d-fc59-41d9-9753-7e6590b9074e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:86:72', 'vm-uuid': 'f5b2b706-4a67-4df5-b0ba-0ec813578b9b'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:14 user nova-compute[75307]: INFO os_vif [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc')
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:f9:86:72, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updated VIF entry in instance network info cache for port 1fc6a47d-fc59-41d9-9753-7e6590b9074e. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updating instance_info_cache with network_info: [{"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:39:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-58f3b974-fcbe-4cd1-8117-243fc449eebe req-bdcc6a93-e095-4e8b-883d-9cabc4365f1d service nova] Releasing lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] No waiting events found dispatching network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:16 user nova-compute[75307]: WARNING nova.compute.manager [req-b700850f-0cf5-4a94-b124-8c46eea9596e req-22d44e4d-ca5a-4146-b331-061276636865 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received unexpected event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e for instance with vm_state building and task_state spawning.
Nov 13 23:39:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:39:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Instance spawned successfully.
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:17 user nova-compute[75307]: INFO nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 13 23:39:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:39:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] No waiting events found dispatching network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:18 user nova-compute[75307]: WARNING nova.compute.manager [req-4b6127a5-404d-4775-957e-6cf6c1a9671d req-8a0978f6-edd2-411f-8d13-6eb369f3bbc7 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received unexpected event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e for instance with vm_state active and task_state None.
Nov 13 23:39:18 user nova-compute[75307]: INFO nova.compute.manager [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Took 6.13 seconds to build instance.
Nov 13 23:39:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c3aca288-d477-41e6-83f2-c781ba715185 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.244s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:39:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:39:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:39:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:39:27 user nova-compute[75307]: INFO nova.compute.claims [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Claim successful on node user
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.381s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:39:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.policy [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049e1cfffeef4a1996a661e5a3894ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324dfec822e6496d9601b2198091aa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:39:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:39:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Creating image(s)
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Successfully created port: 8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.475s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8624MB free_disk=25.212581634521484GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 76cf692b-48a2-4db6-8d81-7c82a2678fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk 1073741824" returned: 0 in 0.050s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:39:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Cannot resize image /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Ensure instance console log exists: /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Successfully updated port: 8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-changed-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Refreshing instance network info cache due to event network-changed-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] Acquiring lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updating instance_info_cache with network_info: [{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Instance network_info: |[{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] Acquired lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Refreshing network info cache for port 8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Start _get_guest_xml network_info=[{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:39:29 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:29 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-628874380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-628874380',id=45,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0ncc2pyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:39:28Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f8798e24-93a8-4aa0-a54e-00fc39cf69d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.objects.instance [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid f8798e24-93a8-4aa0-a54e-00fc39cf69d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:39:29 user nova-compute[75307]:   <uuid>f8798e24-93a8-4aa0-a54e-00fc39cf69d4</uuid>
Nov 13 23:39:29 user nova-compute[75307]:   <name>instance-0000002d</name>
Nov 13 23:39:29 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:39:29 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:39:29 user nova-compute[75307]:   <metadata>
Nov 13 23:39:29 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:39:29 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-628874380</nova:name>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:39:29</nova:creationTime>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:39:29 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:39:29 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:owner>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:39:29 user nova-compute[75307]:       </nova:owner>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:39:29 user nova-compute[75307]:       <nova:ports>
Nov 13 23:39:29 user nova-compute[75307]:         <nova:port uuid="8add43b2-89df-46e6-b64b-0ce2ab1f7dbe">
Nov 13 23:39:29 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 13 23:39:29 user nova-compute[75307]:         </nova:port>
Nov 13 23:39:29 user nova-compute[75307]:       </nova:ports>
Nov 13 23:39:29 user nova-compute[75307]:     </nova:instance>
Nov 13 23:39:29 user nova-compute[75307]:   </metadata>
Nov 13 23:39:29 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:39:29 user nova-compute[75307]:     <system>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="serial">f8798e24-93a8-4aa0-a54e-00fc39cf69d4</entry>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="uuid">f8798e24-93a8-4aa0-a54e-00fc39cf69d4</entry>
Nov 13 23:39:29 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:39:29 user nova-compute[75307]:     </system>
Nov 13 23:39:29 user nova-compute[75307]:   </sysinfo>
Nov 13 23:39:29 user nova-compute[75307]:   <os>
Nov 13 23:39:29 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:39:29 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:39:29 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:39:29 user nova-compute[75307]:   </os>
Nov 13 23:39:29 user nova-compute[75307]:   <features>
Nov 13 23:39:29 user nova-compute[75307]:     <acpi/>
Nov 13 23:39:29 user nova-compute[75307]:     <apic/>
Nov 13 23:39:29 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:39:29 user nova-compute[75307]:   </features>
Nov 13 23:39:29 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:39:29 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:39:29 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:39:29 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:39:29 user nova-compute[75307]:   </clock>
Nov 13 23:39:29 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:39:29 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:39:29 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:39:29 user nova-compute[75307]:   </cpu>
Nov 13 23:39:29 user nova-compute[75307]:   <devices>
Nov 13 23:39:29 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:39:29 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:39:29 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk"/>
Nov 13 23:39:29 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:39:29 user nova-compute[75307]:     </disk>
Nov 13 23:39:29 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:39:29 user nova-compute[75307]:       <mac address="fa:16:3e:d6:67:2b"/>
Nov 13 23:39:29 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:39:29 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:39:29 user nova-compute[75307]:       <target dev="tap8add43b2-89"/>
Nov 13 23:39:29 user nova-compute[75307]:     </interface>
Nov 13 23:39:29 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:39:29 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/console.log" append="off"/>
Nov 13 23:39:29 user nova-compute[75307]:     </serial>
Nov 13 23:39:29 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:39:29 user nova-compute[75307]:     <video>
Nov 13 23:39:29 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:39:29 user nova-compute[75307]:     </video>
Nov 13 23:39:29 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:39:29 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:39:29 user nova-compute[75307]:     </rng>
Nov 13 23:39:29 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:39:29 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:39:29 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:39:29 user nova-compute[75307]:     </memballoon>
Nov 13 23:39:29 user nova-compute[75307]:   </devices>
Nov 13 23:39:29 user nova-compute[75307]: </domain>
Nov 13 23:39:29 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-628874380',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-628874380',id=45,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0ncc2pyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:39:28Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f8798e24-93a8-4aa0-a54e-00fc39cf69d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG os_vif [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89a74149-30f9-5c91-8bbe-93a561363da9', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8add43b2-89, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8add43b2-89, col_values=(('qos', UUID('33c1d9c9-d065-4d9a-980b-63eec3d6bc7e')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8add43b2-89, col_values=(('external_ids', {'iface-id': '8add43b2-89df-46e6-b64b-0ce2ab1f7dbe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:67:2b', 'vm-uuid': 'f8798e24-93a8-4aa0-a54e-00fc39cf69d4'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:29 user nova-compute[75307]: INFO os_vif [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89')
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:d6:67:2b, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updated VIF entry in instance network info cache for port 8add43b2-89df-46e6-b64b-0ce2ab1f7dbe. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updating instance_info_cache with network_info: [{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:39:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c666b0c4-1613-45d2-befe-1ab6abf0c74d req-2ea7c37a-a58d-4ddd-8eac-271992eca38a service nova] Releasing lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:39:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] No waiting events found dispatching network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:31 user nova-compute[75307]: WARNING nova.compute.manager [req-cba149eb-f2cc-47d2-a3c2-e1c263dd1a2c req-7a14a1ef-c06b-4700-96fc-421d618fb213 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received unexpected event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe for instance with vm_state building and task_state spawning.
Nov 13 23:39:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:39:33 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Instance spawned successfully.
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:39:33 user nova-compute[75307]: INFO nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:39:33 user nova-compute[75307]: INFO nova.compute.manager [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Took 5.97 seconds to build instance.
Nov 13 23:39:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-c7030a5f-4dda-47e1-817b-3168285623b6 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.064s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:39:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] No waiting events found dispatching network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:39:33 user nova-compute[75307]: WARNING nova.compute.manager [req-f059d6d1-eb98-4b84-87a2-6ffef12728a4 req-d5399fed-e0cc-460c-8b3f-751bce2e195e service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received unexpected event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe for instance with vm_state active and task_state None.
Nov 13 23:39:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:39:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:16 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:40:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:40:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:26 user nova-compute[75307]: INFO nova.compute.manager [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Unshelving
Nov 13 23:40:27 user nova-compute[75307]: INFO nova.virt.block_device [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Booting with volume d8c9c117-e296-4d79-b405-5078614b841b at /dev/vda
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.utils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a6dd08-ab4c-436a-b9a8-52c1eb1d330f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[000308b6-61b4-4c71-a27e-864428704eff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[209e1131-ab21-4db2-a9d1-b8fc29aa77a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[068fa56f-7168-4d8e-a4bd-f16685da7cff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:40:27 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:40:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[334bf547-c87d-40cf-921f-280bcb28c043]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG os_brick.utils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:40:27 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating existing volume attachment record: 595aacdf-e227-4f85-b94e-31d514a980e8 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:40:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.154979705810547GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 76cf692b-48a2-4db6-8d81-7c82a2678fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:40:30 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'pci_requests' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'numa_topology' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:40:31 user nova-compute[75307]: INFO nova.compute.claims [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Claim successful on node user
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:40:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:31 user nova-compute[75307]: INFO nova.network.neutron [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating port f770263d-357f-4d15-95f4-d4f8a10fd808 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing instance network info cache due to event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:40:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Creating image(s)
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Ensure instance console log exists: /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start _get_guest_xml network_info=[{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac', 'attached_at': '', 'detached_at': '', 'volume_id': 'd8c9c117-e296-4d79-b405-5078614b841b', 'serial': 'd8c9c117-e296-4d79-b405-5078614b841b'}, 'delete_on_termination': True, 'attachment_id': '595aacdf-e227-4f85-b94e-31d514a980e8', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.network.neutron [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:40:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:40:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.objects.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Object Instance<8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:40:32 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:40:32 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:40:32 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d537bc-8cd1-417f-9f82-fad382cc5a7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:40:32 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fd45e7-997b-41ba-b7c8-ea82abfbad4c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b] added
Nov 13 23:40:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2069b0-8801-4972-b05d-65c4547c52a6]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[421d86e7-d151-4e35-b40c-ee26b1494354]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuafmCwL {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PuafmCwL" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf18415b-0e72-4d85-a60a-f7e37f73e7d1]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PuafmCwL'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4a6d0e-6a5d-48db-a75f-af0841ab6e75]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c4c760-d5ab-4f4c-9787-745b70e474b6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:40:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:40:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2157817-d2e6-4792-9648-5bc9ac4927a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]
Nov 13 23:40:33 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.
Nov 13 23:40:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[013ae2f4-d712-4084-9b54-2a32f89acf4f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5d318-6679-461b-b166-311fc618dd03]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:40:33 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:40:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:40:33 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:40:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e152a880-224c-4900-b0ac-8641fdf12847]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG nova.network.neutron [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updated VIF entry in instance network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG nova.network.neutron [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:40:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9041f6a7-11de-4d67-8f48-908eb0ffa5a1 req-933c9a2b-6870-40c7-a302-7e1291833ffb service nova] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23165653461663939', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165653461663939', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1508157924',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:40:27Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Object Instance<8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:40:34 user nova-compute[75307]:   <uuid>8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</uuid>
Nov 13 23:40:34 user nova-compute[75307]:   <name>instance-0000002a</name>
Nov 13 23:40:34 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:40:34 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:40:34 user nova-compute[75307]:   <metadata>
Nov 13 23:40:34 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:40:34 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:40:34 user nova-compute[75307]:       <nova:name>tempest-TestShelveInstance-server-603910968</nova:name>
Nov 13 23:40:34 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:40:32</nova:creationTime>
Nov 13 23:40:34 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:40:34 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:40:34 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:40:34 user nova-compute[75307]:       <nova:owner>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:user uuid="8cd34ad79490409d8a6ea1f82cb050a2">tempest-TestShelveInstance-1952798290-project-member</nova:user>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:project uuid="5154ef16f778469aa278e00bd65c3881">tempest-TestShelveInstance-1952798290</nova:project>
Nov 13 23:40:34 user nova-compute[75307]:       </nova:owner>
Nov 13 23:40:34 user nova-compute[75307]:       <nova:ports>
Nov 13 23:40:34 user nova-compute[75307]:         <nova:port uuid="f770263d-357f-4d15-95f4-d4f8a10fd808">
Nov 13 23:40:34 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 13 23:40:34 user nova-compute[75307]:         </nova:port>
Nov 13 23:40:34 user nova-compute[75307]:       </nova:ports>
Nov 13 23:40:34 user nova-compute[75307]:     </nova:instance>
Nov 13 23:40:34 user nova-compute[75307]:   </metadata>
Nov 13 23:40:34 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:40:34 user nova-compute[75307]:     <system>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="serial">8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</entry>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="uuid">8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac</entry>
Nov 13 23:40:34 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:40:34 user nova-compute[75307]:     </system>
Nov 13 23:40:34 user nova-compute[75307]:   </sysinfo>
Nov 13 23:40:34 user nova-compute[75307]:   <os>
Nov 13 23:40:34 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:40:34 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:40:34 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:40:34 user nova-compute[75307]:   </os>
Nov 13 23:40:34 user nova-compute[75307]:   <features>
Nov 13 23:40:34 user nova-compute[75307]:     <acpi/>
Nov 13 23:40:34 user nova-compute[75307]:     <apic/>
Nov 13 23:40:34 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:40:34 user nova-compute[75307]:   </features>
Nov 13 23:40:34 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:40:34 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:40:34 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:40:34 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:40:34 user nova-compute[75307]:   </clock>
Nov 13 23:40:34 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:40:34 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:40:34 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:40:34 user nova-compute[75307]:   </cpu>
Nov 13 23:40:34 user nova-compute[75307]:   <devices>
Nov 13 23:40:34 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:40:34 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:40:34 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:40:34 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:40:34 user nova-compute[75307]:       <serial>d8c9c117-e296-4d79-b405-5078614b841b</serial>
Nov 13 23:40:34 user nova-compute[75307]:     </disk>
Nov 13 23:40:34 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:40:34 user nova-compute[75307]:       <mac address="fa:16:3e:3d:ee:bd"/>
Nov 13 23:40:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:40:34 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:40:34 user nova-compute[75307]:       <target dev="tapf770263d-35"/>
Nov 13 23:40:34 user nova-compute[75307]:     </interface>
Nov 13 23:40:34 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:40:34 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac/console.log" append="off"/>
Nov 13 23:40:34 user nova-compute[75307]:     </serial>
Nov 13 23:40:34 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:40:34 user nova-compute[75307]:     <video>
Nov 13 23:40:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:40:34 user nova-compute[75307]:     </video>
Nov 13 23:40:34 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:40:34 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:40:34 user nova-compute[75307]:     </rng>
Nov 13 23:40:34 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:40:34 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:40:34 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:40:34 user nova-compute[75307]:     </memballoon>
Nov 13 23:40:34 user nova-compute[75307]:   </devices>
Nov 13 23:40:34 user nova-compute[75307]: </domain>
Nov 13 23:40:34 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1508157924',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:36:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:40:27Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG os_vif [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e6a00b1-9bf7-5996-be60-7909543c1e87', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf770263d-35, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf770263d-35, col_values=(('qos', UUID('744684cd-558a-40ff-a919-cea36a1fd6e4')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf770263d-35, col_values=(('external_ids', {'iface-id': 'f770263d-357f-4d15-95f4-d4f8a10fd808', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:ee:bd', 'vm-uuid': '8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:34 user nova-compute[75307]: INFO os_vif [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35')
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:40:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] No VIF found with MAC fa:16:3e:3d:ee:bd, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:35 user nova-compute[75307]: DEBUG nova.compute.manager [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:40:35 user nova-compute[75307]: WARNING nova.compute.manager [req-fc35c13a-ca4e-455b-9806-1981fe8e9861 req-fdab99ad-bc35-4677-b5fc-3ad80cf834bc service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 23:40:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:40:37 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance spawned successfully.
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e0f0e54b-ba01-417f-966e-08a03f615bff tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.830s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:37 user nova-compute[75307]: DEBUG nova.compute.manager [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:40:37 user nova-compute[75307]: WARNING nova.compute.manager [req-aeb372b3-8ec0-4b75-a899-08741d88abcb req-8d048ebd-1ede-4f70-88ee-a6e4072525ee service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state active and task_state None.
Nov 13 23:40:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG nova.compute.manager [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing instance network info cache due to event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:40:48 user nova-compute[75307]: DEBUG nova.network.neutron [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:40:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updated VIF entry in instance network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:40:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:40:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b6093ed8-65da-4dd0-8b0f-367c01b548cb req-1f0905fa-7fce-4a4d-90af-e756a79cb327 service nova] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:51 user nova-compute[75307]: INFO nova.compute.manager [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Shelving
Nov 13 23:40:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:40:51 user nova-compute[75307]: WARNING nova.compute.manager [req-83210ffb-9192-41a8-82e3-7d2b9b9b7ede req-f10fa5ea-64a6-4d80-a50a-fb76ad10bf39 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state active and task_state shelving.
Nov 13 23:40:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance destroyed successfully.
Nov 13 23:40:52 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Beginning cold snapshot process
Nov 13 23:40:52 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:40:52 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk /opt/stack/data/nova/instances/snapshots/tmp4lc734gc/e86cdbaa7d3546679dbc49e3cddf1c7f {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:40:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:53 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk /opt/stack/data/nova/instances/snapshots/tmp4lc734gc/e86cdbaa7d3546679dbc49e3cddf1c7f" returned: 0 in 0.711s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:40:53 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Snapshot extracted, beginning image upload
Nov 13 23:40:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:53 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:53 user nova-compute[75307]: DEBUG nova.compute.manager [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:40:53 user nova-compute[75307]: WARNING nova.compute.manager [req-d0add89d-2fad-4bee-b58f-bc79e20f75e7 req-6b16a764-43de-4ff3-bc2b-2d7823f8d347 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 23:40:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Snapshot image upload complete
Nov 13 23:40:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:40:55 user nova-compute[75307]: INFO nova.compute.manager [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Shelve offloading
Nov 13 23:40:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance destroyed successfully.
Nov 13 23:40:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:40:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:40:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:40:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:40:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance destroyed successfully.
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'resources' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5B94VWw6po+HawKe7jlIH8Bz4MjMGA1B0hFH+wk7kgvCn5zvf9xqxXYLRkvA4VPQRMKxa5RchxvrtusS7ZvJy35P+TLjgGn/ZRa82yJ/IVjtUqW3As4iZm49q1YN2KNg==',key_name='tempest-keypair-140235525',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:40:55.671774',shelved_host='user',shelved_image_id='0bd46600-4f0c-4c0b-842f-bf6406870c71'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:40:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG os_vif [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebdd6d8-9b, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing instance network info cache due to event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dabdffff-5730-4f13-b8b6-f6082295b5d8) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:40:56 user nova-compute[75307]: INFO os_vif [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b')
Nov 13 23:40:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Deleting instance files /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad_del
Nov 13 23:40:56 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Deletion of /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad_del complete
Nov 13 23:40:56 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Deleted allocations for instance 76cf692b-48a2-4db6-8d81-7c82a2678fad
Nov 13 23:40:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.objects.instance [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'numa_topology' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.objects.base [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<76cf692b-48a2-4db6-8d81-7c82a2678fad> lazy-loaded attributes: resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.network.neutron [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updated VIF entry in instance network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG nova.network.neutron [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-797e3479-9470-4204-bfdb-2829be029290 req-c5e21110-d5c5-4293-8dd3-4c1ccf2deece service nova] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-6848384e-14e0-4d4d-a932-5d992425203c tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.866s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:40:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-changed-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Refreshing instance network info cache due to event network-changed-1fc6a47d-fc59-41d9-9753-7e6590b9074e. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] Acquiring lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] Acquired lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Refreshing network info cache for port 1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:41:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updated VIF entry in instance network info cache for port 1fc6a47d-fc59-41d9-9753-7e6590b9074e. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:41:03 user nova-compute[75307]: DEBUG nova.network.neutron [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updating instance_info_cache with network_info: [{"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:41:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-fd43207a-1008-43ca-8cc4-b8e89f616d83 req-6cb38c43-1ca4-4dbb-842c-a6b0f6ddc449 service nova] Releasing lock "refresh_cache-f5b2b706-4a67-4df5-b0ba-0ec813578b9b" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:05 user nova-compute[75307]: INFO nova.compute.manager [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Attaching volume 4e4aa3cb-2461-46d8-b603-926a0e8b6652 to /dev/vdb
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.utils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da820618-8d7e-49ab-8b0a-5c3c6a7e5724]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26a56c5-addb-4407-8243-07281d4dcaca]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69aed23-85d8-4061-899b-d5ff2dc41ed8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[269abf67-c46a-46ae-9426-23eeee9afe45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:41:05 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:41:05 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbd4725-0bd8-4b20-91fa-889877f162fa]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG os_brick.utils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:41:05 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updating existing volume attachment record: 94408816-6a87-402f-8ad5-c17769d03b06 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:41:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EONiMPzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:41:09 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:41:09 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:41:09 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7be164b9-1f92-4dd4-89c5-989ab3e1c01c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:41:09 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a46d09-31f3-42aa-b12b-4347ca1cbfa5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652] added
Nov 13 23:41:09 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43de723-ec99-4e88-95ca-663f42f4ab95]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7c996d-3b96-4923-b2df-4f4ef812aa06]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EONiMPzg {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EONiMPzg" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce13f13-f73b-4ff7-a6b3-3891e3f63fd7]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EONiMPzg'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f567c8-9578-4fc4-8917-fd49ae679d27]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:09 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f086bc7-4d13-40e0-b22c-367e3f75dcb6]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e354cc-3c4f-425b-9ebc-8f7317613f5c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260]
Nov 13 23:41:10 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260] successful.
Nov 13 23:41:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2833e0-9294-4f9c-a2e9-bfb55f2cc208]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df862011-7d6d-4c26-928b-079f5b15f492]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:10 user nova-compute[75307]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)
Nov 13 23:41:10 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d617b27-53e9-4e99-93ba-92a81e7b6b13]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:41:10 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EONiMPzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26631333739613665', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631333739613665', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] attach device xml: <disk type="block" device="disk">
Nov 13 23:41:11 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:41:11 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:41:11 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:41:11 user nova-compute[75307]:   <serial>4e4aa3cb-2461-46d8-b603-926a0e8b6652</serial>
Nov 13 23:41:11 user nova-compute[75307]: </disk>
Nov 13 23:41:11 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] No VIF found with MAC fa:16:3e:f9:86:72, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1486c7c7-ed45-4734-b541-5a4408f70945 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 5.946s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:12 user nova-compute[75307]: INFO nova.compute.manager [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Detaching volume 4e4aa3cb-2461-46d8-b603-926a0e8b6652
Nov 13 23:41:12 user nova-compute[75307]: INFO nova.virt.block_device [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Attempting to driver detach volume 4e4aa3cb-2461-46d8-b603-926a0e8b6652 from mountpoint /dev/vdb
Nov 13 23:41:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Attempting to detach device vdb from instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:41:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:41:12 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:41:12 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:41:12 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:41:12 user nova-compute[75307]:   <serial>4e4aa3cb-2461-46d8-b603-926a0e8b6652</serial>
Nov 13 23:41:12 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:41:12 user nova-compute[75307]: </disk>
Nov 13 23:41:12 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:41:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b from the persistent domain config.
Nov 13 23:41:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:41:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:41:12 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:41:12 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:41:12 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 13 23:41:12 user nova-compute[75307]:   <serial>4e4aa3cb-2461-46d8-b603-926a0e8b6652</serial>
Nov 13 23:41:12 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 13 23:41:12 user nova-compute[75307]: </disk>
Nov 13 23:41:12 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:41:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:41:15 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:41:18 user nova-compute[75307]: INFO nova.compute.manager [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] instance snapshotting
Nov 13 23:41:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Beginning live snapshot process
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json -f qcow2 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f.delta 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f.delta 1073741824" returned: 0 in 0.054s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 13 23:41:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:41:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75307) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 13 23:41:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 13 23:41:20 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:41:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f.delta /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f.delta /opt/stack/data/nova/instances/snapshots/tmpodmapytn/5e05ea02ea5f4d5298a29662aca2282f" returned: 0 in 0.513s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Snapshot extracted, beginning image upload
Nov 13 23:41:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:41:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:41:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:41:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:41:23 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Snapshot image upload complete
Nov 13 23:41:23 user nova-compute[75307]: INFO nova.compute.manager [None req-9cf1651d-2ade-4d74-acc4-9799dde16343 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Took 5.40 seconds to snapshot the instance on the hypervisor.
Nov 13 23:41:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:41:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:41:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8517MB free_disk=25.082942962646484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:41:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:41:33 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b is timed out.
Nov 13 23:41:33 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully detached device vdb from instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b from the live domain config.
Nov 13 23:41:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EONiMPzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:41:33 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb8fd201-8b9b-4fcc-91e5-74de5ba3a3b9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:41:33 user nova-compute[75307]: No targets found.
Nov 13 23:41:33 user nova-compute[75307]: iSNS:
Nov 13 23:41:33 user nova-compute[75307]: No targets found.
Nov 13 23:41:33 user nova-compute[75307]: STATIC:
Nov 13 23:41:33 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:41:33 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:41:33 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:41:33 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:41:33 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:41:33 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:41:33 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652
Nov 13 23:41:33 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:41:33 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:41:33 user nova-compute[75307]: FIRMWARE:
Nov 13 23:41:33 user nova-compute[75307]: No targets found.
Nov 13 23:41:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:41:33 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:41:33 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b35d3a-f169-46aa-ac1e-e78cb2d7e51f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3825c1f-6dff-4a0c-91a4-a2e354cb25b2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:33 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:33 user nova-compute[75307]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)
Nov 13 23:41:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:41:33 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:41:33 user nova-compute[75307]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 (non-flash)
Nov 13 23:41:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34775630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f459f74-200c-464b-8122-09cb9844196d]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b3662d-be51-4f9d-ba8a-99062c69c2bf]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7620380e-387a-464e-8970-7e6455801129]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[635bb6dc-693a-459b-8997-4f038aaf8eac]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7187b387-620a-4d87-817c-8b6a72becd8a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aec731-0959-40d7-a2eb-e055e14c035d]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260]
Nov 13 23:41:33 user nova-compute[75307]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652, portal: 172.16.0.220,3260] successful.
Nov 13 23:41:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e4aa3cb-2461-46d8-b603-926a0e8b6652 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f449d-49ce-434c-b3d7-09b5518a3935]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] <== disconnect_volume: return (292ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:41:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:41:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'flavor' on Instance uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:41:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b3119936-1a97-457d-ab76-c5b51e6f28bd tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.553s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:41:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid f8798e24-93a8-4aa0-a54e-00fc39cf69d4 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:41:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:41:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:02 user nova-compute[75307]: INFO nova.compute.manager [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Terminating instance
Nov 13 23:42:02 user nova-compute[75307]: DEBUG nova.compute.manager [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-unplugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] No waiting events found dispatching network-vif-unplugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-310e8031-3eba-451a-b603-1836eb6fc894 req-07263978-3a8d-4be2-953e-806298227058 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-unplugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Instance destroyed successfully.
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lazy-loading 'resources' on Instance uuid f5b2b706-4a67-4df5-b0ba-0ec813578b9b {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1314012456',display_name='tempest-AttachVolumeNegativeTest-server-1314012456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1314012456',id=44,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHDb3Q8Z0DYLnHEHuAv2GEEC3THuoodaBjr7imD31gzzCcpTeonzzms0Fnov6qM+c6D7Op8oishqjynUJAKsFSHSdSYfE4CRcp7aCRrKAp/iCbOHnZZe7sqFyn6OqaS8pw==',key_name='tempest-keypair-1375224651',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:39:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='048088f95c114110be9def433f1fd534',ramdisk_id='',reservation_id='r-0q9huntn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-676261937',owner_user_name='tempest-AttachVolumeNegativeTest-676261937-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:39:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f1bf68aa47d54db7b01286e246e2e655',uuid=f5b2b706-4a67-4df5-b0ba-0ec813578b9b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converting VIF {"id": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "address": "fa:16:3e:f9:86:72", "network": {"id": "844ca821-c2b5-4b1e-9c7d-64cc892bb210", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1157658818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "048088f95c114110be9def433f1fd534", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1fc6a47d-fc", "ovs_interfaceid": "1fc6a47d-fc59-41d9-9753-7e6590b9074e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG os_vif [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1fc6a47d-fc, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed003ed0-7372-4e39-ba2c-ae3c4b7ea298) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:03 user nova-compute[75307]: INFO os_vif [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:86:72,bridge_name='br-int',has_traffic_filtering=True,id=1fc6a47d-fc59-41d9-9753-7e6590b9074e,network=Network(844ca821-c2b5-4b1e-9c7d-64cc892bb210),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1fc6a47d-fc')
Nov 13 23:42:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Deleting instance files /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b_del
Nov 13 23:42:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Deletion of /opt/stack/data/nova/instances/f5b2b706-4a67-4df5-b0ba-0ec813578b9b_del complete
Nov 13 23:42:03 user nova-compute[75307]: INFO nova.compute.manager [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 23:42:03 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:42:03 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:42:04 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:04 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Took 0.75 seconds to deallocate network for instance.
Nov 13 23:42:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:42:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:42:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:04 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Deleted allocations for instance f5b2b706-4a67-4df5-b0ba-0ec813578b9b
Nov 13 23:42:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-4dc8e025-6bdd-4a82-9450-6429bb37cc40 tempest-AttachVolumeNegativeTest-676261937 tempest-AttachVolumeNegativeTest-676261937-project-member] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] Acquiring lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] Lock "f5b2b706-4a67-4df5-b0ba-0ec813578b9b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] No waiting events found dispatching network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:05 user nova-compute[75307]: WARNING nova.compute.manager [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received unexpected event network-vif-plugged-1fc6a47d-fc59-41d9-9753-7e6590b9074e for instance with vm_state deleted and task_state None.
Nov 13 23:42:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-472c95b2-c846-48e4-b938-743b58da48a3 req-231cf916-76f7-4b11-8d9c-07fee7e60c87 service nova] [instance: f5b2b706-4a67-4df5-b0ba-0ec813578b9b] Received event network-vif-deleted-1fc6a47d-fc59-41d9-9753-7e6590b9074e {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:17 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing instance network info cache due to event network-changed-f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] Acquiring lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] Acquired lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Refreshing network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:18 user nova-compute[75307]: INFO nova.compute.manager [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Terminating instance
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.compute.manager [req-1f9bb896-b490-40e5-93a9-e78b2acf8abf req-1d051f8b-19bb-4c13-a345-787abe5e33b3 service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-unplugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updated VIF entry in instance network info cache for port f770263d-357f-4d15-95f4-d4f8a10fd808. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG nova.network.neutron [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [{"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-db28bbce-0e2c-4ed7-96e2-9fc4c84c3aeb req-2af9d589-11bf-4695-b688-bcb7ba35d41a service nova] Releasing lock "refresh_cache-8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Instance destroyed successfully.
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.objects.instance [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lazy-loading 'resources' on Instance uuid 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:36:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-603910968',display_name='tempest-TestShelveInstance-server-603910968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-603910968',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDsOaPLmOg3yofJinacuU5A7ZEXFuHQOe/bnovkupNhbpe7OofVVKAnYUGoff8Fk4DQyysdqdXYyLlBHX8dso6Xdc1KIFj2Ms9EoGiyRah40lGQ6cYC+xuMmS88gd2LofQ==',key_name='tempest-TestShelveInstance-1508157924',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:40:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5154ef16f778469aa278e00bd65c3881',ramdisk_id='',reservation_id='r-64qqnvtd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1952798290',owner_user_name='tempest-TestShelveInstance-1952798290-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:40:38Z,user_data=None,user_id='8cd34ad79490409d8a6ea1f82cb050a2',uuid=8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converting VIF {"id": "f770263d-357f-4d15-95f4-d4f8a10fd808", "address": "fa:16:3e:3d:ee:bd", "network": {"id": "ad26e79d-3670-4dd1-af72-b6b9dae29943", "bridge": "br-int", "label": "tempest-TestShelveInstance-1595227508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.73", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5154ef16f778469aa278e00bd65c3881", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf770263d-35", "ovs_interfaceid": "f770263d-357f-4d15-95f4-d4f8a10fd808", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_vif [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf770263d-35, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=744684cd-558a-40ff-a919-cea36a1fd6e4) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:19 user nova-compute[75307]: INFO os_vif [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:ee:bd,bridge_name='br-int',has_traffic_filtering=True,id=f770263d-357f-4d15-95f4-d4f8a10fd808,network=Network(ad26e79d-3670-4dd1-af72-b6b9dae29943),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf770263d-35')
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PuafmCwL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:42:19 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0946b5f7-0c8e-4ddd-b5f1-bd462997dbb8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:42:19 user nova-compute[75307]: No targets found.
Nov 13 23:42:19 user nova-compute[75307]: iSNS:
Nov 13 23:42:19 user nova-compute[75307]: No targets found.
Nov 13 23:42:19 user nova-compute[75307]: STATIC:
Nov 13 23:42:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b
Nov 13 23:42:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:42:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:42:19 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:42:19 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:42:19 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:42:19 user nova-compute[75307]: FIRMWARE:
Nov 13 23:42:19 user nova-compute[75307]: No targets found.
Nov 13 23:42:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:42:19 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:42:19 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[69af3b5f-9fe4-4a7e-848e-a85180cba5d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0073177b-0f45-4771-ad4c-38d145b432db]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:19 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:42:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:19 user nova-compute[75307]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b (non-flash)
Nov 13 23:42:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c6cf2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e7ca4c-1106-4cb5-a39f-39a12d80632d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[838aa391-0565-468f-af7f-868d55d2265a]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[12e89148-ba65-4e5c-9abe-9282c03b9f68]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2084c-f824-4b34-b7e9-d378bada5f32]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b51e88', '/dev/disk/by-id/scsi-1SCST_BIO8b51e88-1ee4af99b224792a', '/dev/disk/by-id/scsi-23165653461663939') {{(pid=85241) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59b9b66-e906-423d-881a-1b81afb60995]: (4, None) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[355c6427-72fa-406c-8f27-85bfb6b9681a]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d25d8d-3034-42c6-afa6-d5bee6cb99ba]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260]
Nov 13 23:42:19 user nova-compute[75307]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b, portal: 172.16.0.220,3260] successful.
Nov 13 23:42:19 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8c9c117-e296-4d79-b405-5078614b841b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[685a80b7-e362-4fd7-b782-f4f6e27c47fa]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] <== disconnect_volume: return (316ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:42:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deleting instance files /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac_del
Nov 13 23:42:19 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deletion of /opt/stack/data/nova/instances/8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac_del complete
Nov 13 23:42:19 user nova-compute[75307]: INFO nova.compute.manager [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 13 23:42:19 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:42:19 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:20 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Took 0.45 seconds to deallocate network for instance.
Nov 13 23:42:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-26c8560f-b5bb-440e-be2b-797279ed2497 req-4463d98e-d86f-4752-94ff-86c2d6b2f1cf service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-deleted-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:20 user nova-compute[75307]: INFO nova.compute.manager [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Took 0.74 seconds to detach 1 volumes for instance.
Nov 13 23:42:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Deleting volume: d8c9c117-e296-4d79-b405-5078614b841b {{(pid=75307) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] Acquiring lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG nova.compute.manager [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] No waiting events found dispatching network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:20 user nova-compute[75307]: WARNING nova.compute.manager [req-40339fad-5906-4a7a-bcde-277e4960e7a0 req-600c091b-a6e3-4a68-b76c-8024cbeb891a service nova] [instance: 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac] Received unexpected event network-vif-plugged-f770263d-357f-4d15-95f4-d4f8a10fd808 for instance with vm_state active and task_state deleting.
Nov 13 23:42:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:21 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:42:21 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:42:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:21 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Deleted allocations for instance 8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac
Nov 13 23:42:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-9673a207-6bad-40f5-89a6-39d378dbc316 tempest-TestShelveInstance-1952798290 tempest-TestShelveInstance-1952798290-project-member] Lock "8a25daf2-ee8b-48b4-8bd8-2502e5cd6dac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.863s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:42:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:42:25 user nova-compute[75307]: INFO nova.compute.claims [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Claim successful on node user
Nov 13 23:42:25 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:42:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:42:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:42:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:42:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:42:26 user nova-compute[75307]: INFO nova.virt.block_device [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Booting with volume-backed-image dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7 at /dev/vda
Nov 13 23:42:26 user nova-compute[75307]: DEBUG nova.policy [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '049e1cfffeef4a1996a661e5a3894ac1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '324dfec822e6496d9601b2198091aa31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:42:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Successfully created port: 0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Successfully updated port: 0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-changed-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.compute.manager [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Refreshing instance network info cache due to event network-changed-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] Acquiring lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating instance_info_cache with network_info: [{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance network_info: |[{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] Acquired lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:27 user nova-compute[75307]: DEBUG nova.network.neutron [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Refreshing network info cache for port 0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:42:28 user nova-compute[75307]: DEBUG nova.network.neutron [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updated VIF entry in instance network info cache for port 0f0ab348-9946-4f3c-9bcf-c4dc2db06dde. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:42:28 user nova-compute[75307]: DEBUG nova.network.neutron [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating instance_info_cache with network_info: [{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7c5881fd-e4c1-44d2-99a5-41aa78ea85ff req-4ea6b1ed-f388-4b59-ab9e-fdd0e57a0280 service nova] Releasing lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:29 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:30 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8706MB free_disk=25.10946273803711GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:42:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.258s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.utils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6ece9-2fbd-42b5-bf14-aca6bd956c2a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e063cb2-d422-4d35-b925-721e244dc311]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c110e4-2c22-4041-9cdf-d49c4fa52fe3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547a691-eaeb-4095-95da-354dcc4742a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:42:31 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:42:31 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a669bda-16ab-4e81-a407-8a44eef5cd7f]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG os_brick.utils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:42:31 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating existing volume attachment record: e1f520d4-c3eb-4a49-be8a-8dec3df30864 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:42:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:42:35 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Creating image(s)
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Did not create local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Ensure instance console log exists: /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start _get_guest_xml network_info=[{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '17b26140-038a-41c7-afb3-ba4b81758d16', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'serial': 'cdbf76a4-f147-44ef-ba3a-6634fdd92a47'}, 'delete_on_termination': False, 'attachment_id': 'e1f520d4-c3eb-4a49-be8a-8dec3df30864', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:42:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:42:35 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:42:35 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:42:35 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c6ff0f-7cf0-4cbe-97d9-0d87a17aa16a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:42:35 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9db79-f4bd-4107-a7d6-508424ab73ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47] added
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e26d74d-e4da-402b-b56b-d29d27e8534d]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504fa31-ad72-479f-ac34-eed8a315cf04]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrPqVRfY {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrPqVRfY" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14c1d33-8eb5-459c-a561-cd34a3b78d9c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrPqVRfY'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a985f54-9adf-424a-99e7-cdfaea6264dc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[446dcf27-4d02-4235-a589-9b263280b9c9]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[66eddfb4-7e92-491f-afb1-c33bbbbe2bca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260]
Nov 13 23:42:36 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260] successful.
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b3ab6c-8160-46e1-a8c8-3ec6da4c8b68]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f4dc09-b9d3-485b-89d8-08b2c147189f]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:36 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[649dfee3-b75f-4fa9-b072-7d72f7099fbf]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:36 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23839386437633866', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839386437633866', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2045005181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2045005181',id=46,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-1u2a4qqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:42:26Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=17b26140-038a-41c7-afb3-ba4b81758d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.objects.instance [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:42:37 user nova-compute[75307]:   <uuid>17b26140-038a-41c7-afb3-ba4b81758d16</uuid>
Nov 13 23:42:37 user nova-compute[75307]:   <name>instance-0000002e</name>
Nov 13 23:42:37 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:42:37 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:42:37 user nova-compute[75307]:   <metadata>
Nov 13 23:42:37 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:42:37 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2045005181</nova:name>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:42:35</nova:creationTime>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:42:37 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:42:37 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:owner>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:42:37 user nova-compute[75307]:       </nova:owner>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:42:37 user nova-compute[75307]:       <nova:ports>
Nov 13 23:42:37 user nova-compute[75307]:         <nova:port uuid="0f0ab348-9946-4f3c-9bcf-c4dc2db06dde">
Nov 13 23:42:37 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:42:37 user nova-compute[75307]:         </nova:port>
Nov 13 23:42:37 user nova-compute[75307]:       </nova:ports>
Nov 13 23:42:37 user nova-compute[75307]:     </nova:instance>
Nov 13 23:42:37 user nova-compute[75307]:   </metadata>
Nov 13 23:42:37 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:42:37 user nova-compute[75307]:     <system>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="serial">17b26140-038a-41c7-afb3-ba4b81758d16</entry>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="uuid">17b26140-038a-41c7-afb3-ba4b81758d16</entry>
Nov 13 23:42:37 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:42:37 user nova-compute[75307]:     </system>
Nov 13 23:42:37 user nova-compute[75307]:   </sysinfo>
Nov 13 23:42:37 user nova-compute[75307]:   <os>
Nov 13 23:42:37 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:42:37 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:42:37 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:42:37 user nova-compute[75307]:   </os>
Nov 13 23:42:37 user nova-compute[75307]:   <features>
Nov 13 23:42:37 user nova-compute[75307]:     <acpi/>
Nov 13 23:42:37 user nova-compute[75307]:     <apic/>
Nov 13 23:42:37 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:42:37 user nova-compute[75307]:   </features>
Nov 13 23:42:37 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:42:37 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:42:37 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:42:37 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:42:37 user nova-compute[75307]:   </clock>
Nov 13 23:42:37 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:42:37 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:42:37 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:42:37 user nova-compute[75307]:   </cpu>
Nov 13 23:42:37 user nova-compute[75307]:   <devices>
Nov 13 23:42:37 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:42:37 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:42:37 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:42:37 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:42:37 user nova-compute[75307]:       <serial>cdbf76a4-f147-44ef-ba3a-6634fdd92a47</serial>
Nov 13 23:42:37 user nova-compute[75307]:     </disk>
Nov 13 23:42:37 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:42:37 user nova-compute[75307]:       <mac address="fa:16:3e:14:fd:d8"/>
Nov 13 23:42:37 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:42:37 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:42:37 user nova-compute[75307]:       <target dev="tap0f0ab348-99"/>
Nov 13 23:42:37 user nova-compute[75307]:     </interface>
Nov 13 23:42:37 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:42:37 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/console.log" append="off"/>
Nov 13 23:42:37 user nova-compute[75307]:     </serial>
Nov 13 23:42:37 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:42:37 user nova-compute[75307]:     <video>
Nov 13 23:42:37 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:42:37 user nova-compute[75307]:     </video>
Nov 13 23:42:37 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:42:37 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:42:37 user nova-compute[75307]:     </rng>
Nov 13 23:42:37 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:42:37 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:42:37 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:42:37 user nova-compute[75307]:     </memballoon>
Nov 13 23:42:37 user nova-compute[75307]:   </devices>
Nov 13 23:42:37 user nova-compute[75307]: </domain>
Nov 13 23:42:37 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2045005181',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2045005181',id=46,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-1u2a4qqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:42:26Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=17b26140-038a-41c7-afb3-ba4b81758d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG os_vif [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c86796e1-bb6d-52d7-85d1-8885014e399f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f0ab348-99, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f0ab348-99, col_values=(('qos', UUID('da7bea6c-c9e0-4174-9e13-4884be619b7e')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f0ab348-99, col_values=(('external_ids', {'iface-id': '0f0ab348-9946-4f3c-9bcf-c4dc2db06dde', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:fd:d8', 'vm-uuid': '17b26140-038a-41c7-afb3-ba4b81758d16'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:37 user nova-compute[75307]: INFO os_vif [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99')
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:42:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:14:fd:d8, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:38 user nova-compute[75307]: WARNING nova.compute.manager [req-3e948936-4dd4-42aa-9e65-f0289d0680b8 req-7787647c-175f-4383-8537-f37ef0187e9a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state building and task_state spawning.
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:42:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance spawned successfully.
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:42:40 user nova-compute[75307]: INFO nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:42:40 user nova-compute[75307]: INFO nova.compute.manager [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Took 15.12 seconds to build instance.
Nov 13 23:42:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-17dc1cf8-b463-4585-9911-6a81b2629806 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.226s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:40 user nova-compute[75307]: WARNING nova.compute.manager [req-e9526ab9-c3f2-446f-a650-03dfcd639f0e req-2754a062-6af6-4109-aaa1-04ea251aba67 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state None.
Nov 13 23:42:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:42:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:43 user nova-compute[75307]: INFO nova.compute.manager [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Unshelving
Nov 13 23:42:43 user nova-compute[75307]: INFO nova.virt.block_device [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Booting with volume e5909d87-b4e5-4530-8cd1-a68a6174d988 at /dev/vdc
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.utils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[713919f4-d8e1-416c-b293-09af050280db]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8daddf6-a90b-493c-a7f9-8a5110f9e9d5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a32ea-bd37-4604-b058-30ef02eb3849]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4991fa16-a9a0-4481-b416-f9488223af63]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 13 23:42:43 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 13 23:42:43 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bb9b6d-c839-4f84-88b5-f41e2e714cf4]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG os_brick.utils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:42:43 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating existing volume attachment record: 0934e0de-65b7-4fd0-b6e4-7234fe6c29ce {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 13 23:42:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:47 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_requests' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:48 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'numa_topology' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:48 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:42:48 user nova-compute[75307]: INFO nova.compute.claims [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Claim successful on node user
Nov 13 23:42:48 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:42:48 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:42:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.304s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:48 user nova-compute[75307]: INFO nova.network.neutron [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating port febdd6d8-9bb4-4d70-80c6-880c48e5db09 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing instance network info cache due to event network-changed-febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] Acquiring lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.network.neutron [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:42:49 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Creating image(s)
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'trusted_certs' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] Acquired lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.network.neutron [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Refreshing network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG nova.objects.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<76cf692b-48a2-4db6-8d81-7c82a2678fad> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "989f93d027fc9d10f0d31209bca4739718e96dee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "989f93d027fc9d10f0d31209bca4739718e96dee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG nova.virt.images [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] 0bd46600-4f0c-4c0b-842f-bf6406870c71 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.part /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG nova.network.neutron [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updated VIF entry in instance network info cache for port febdd6d8-9bb4-4d70-80c6-880c48e5db09. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG nova.network.neutron [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-18b00fef-185c-4d1a-809d-5cd8f40133e1 req-e6e6a6a8-9d9d-466e-8529-1070274e5c4d service nova] Releasing lock "refresh_cache-76cf692b-48a2-4db6-8d81-7c82a2678fad" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.part /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.converted" returned: 0 in 0.230s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee.converted --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "989f93d027fc9d10f0d31209bca4739718e96dee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.466s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "989f93d027fc9d10f0d31209bca4739718e96dee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "989f93d027fc9d10f0d31209bca4739718e96dee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json" returned: 0 in 0.165s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee,backing_fmt=raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee,backing_fmt=raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk 1073741824" returned: 0 in 0.045s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "989f93d027fc9d10f0d31209bca4739718e96dee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.217s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'migration_context' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG nova.objects.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<76cf692b-48a2-4db6-8d81-7c82a2678fad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:42:51 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Rebasing disk image.
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:51 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc -F raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc -F raw /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk" returned: 0 in 2.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Ensure instance console log exists: /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start _get_guest_xml network_info=[{"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='3b457875dde78d295c37ad0a4657bbc7',container_format='bare',created_at=2023-11-13T23:40:51Z,direct_url=<?>,disk_format='qcow2',id=0bd46600-4f0c-4c0b-842f-bf6406870c71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-614165099-shelved',owner='b267b7151e414c9180bc7c8e5accd6de',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T23:40:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuVOxjtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '76cf692b-48a2-4db6-8d81-7c82a2678fad', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5909d87-b4e5-4530-8cd1-a68a6174d988', 'serial': 'e5909d87-b4e5-4530-8cd1-a68a6174d988'}, 'delete_on_termination': False, 'attachment_id': '0934e0de-65b7-4fd0-b6e4-7234fe6c29ce', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:42:54 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:54 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3b457875dde78d295c37ad0a4657bbc7',container_format='bare',created_at=2023-11-13T23:40:51Z,direct_url=<?>,disk_format='qcow2',id=0bd46600-4f0c-4c0b-842f-bf6406870c71,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-614165099-shelved',owner='b267b7151e414c9180bc7c8e5accd6de',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T23:40:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'vcpu_model' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.objects.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<76cf692b-48a2-4db6-8d81-7c82a2678fad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuVOxjtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:42:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:42:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:42:54 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b4e2aa-6290-4c75-876c-42b988d227ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 13 23:42:54 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bdd204-5aa1-43ce-bd2a-e4a809edda8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988] added
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9556f6-a861-4a61-bcb3-b0f2a22a8ca0]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbf7def-d8f9-4f9a-a4d3-854d0b295c95]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuVOxjtX {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vuVOxjtX" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eafb3e4-1c3b-4172-95f6-4db55cc08621]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vuVOxjtX'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0bf96a-d58a-4628-a927-5f5d347d002b]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87a5b93-c806-4347-8672-c37191c0bcdc]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9783d42-b787-4aa3-8b48-911f76453422]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260]
Nov 13 23:42:54 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260] successful.
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed4f100-6888-4957-8de0-c020d2233892]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec2170a-dd26-4739-a94c-24606fed6999]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:42:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] HCTL ('34', '-', '-', 0) found on session 57 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[eea99cb4-9fb2-4745-909a-7f979fb3c7b2]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching for a device in session 57 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:42:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuVOxjtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23338376535633432', 'path': '/dev/sdc'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338376535633432', 'path': '/dev/sdc'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='0bd46600-4f0c-4c0b-842f-bf6406870c71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-140235525',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:40:55.671774',shelved_host='user',shelved_image_id='0bd46600-4f0c-4c0b-842f-bf6406870c71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_devices' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.objects.base [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<76cf692b-48a2-4db6-8d81-7c82a2678fad> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:42:55 user nova-compute[75307]:   <uuid>76cf692b-48a2-4db6-8d81-7c82a2678fad</uuid>
Nov 13 23:42:55 user nova-compute[75307]:   <name>instance-0000002b</name>
Nov 13 23:42:55 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:42:55 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:42:55 user nova-compute[75307]:   <metadata>
Nov 13 23:42:55 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:42:55 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-614165099</nova:name>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:42:54</nova:creationTime>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:42:55 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:42:55 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:owner>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:user uuid="2709ea16f7b6424a9c67107096249c3e">tempest-AttachVolumeShelveTestJSON-620800295-project-member</nova:user>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:project uuid="b267b7151e414c9180bc7c8e5accd6de">tempest-AttachVolumeShelveTestJSON-620800295</nova:project>
Nov 13 23:42:55 user nova-compute[75307]:       </nova:owner>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:root type="image" uuid="0bd46600-4f0c-4c0b-842f-bf6406870c71"/>
Nov 13 23:42:55 user nova-compute[75307]:       <nova:ports>
Nov 13 23:42:55 user nova-compute[75307]:         <nova:port uuid="febdd6d8-9bb4-4d70-80c6-880c48e5db09">
Nov 13 23:42:55 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:42:55 user nova-compute[75307]:         </nova:port>
Nov 13 23:42:55 user nova-compute[75307]:       </nova:ports>
Nov 13 23:42:55 user nova-compute[75307]:     </nova:instance>
Nov 13 23:42:55 user nova-compute[75307]:   </metadata>
Nov 13 23:42:55 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:42:55 user nova-compute[75307]:     <system>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="serial">76cf692b-48a2-4db6-8d81-7c82a2678fad</entry>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="uuid">76cf692b-48a2-4db6-8d81-7c82a2678fad</entry>
Nov 13 23:42:55 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:42:55 user nova-compute[75307]:     </system>
Nov 13 23:42:55 user nova-compute[75307]:   </sysinfo>
Nov 13 23:42:55 user nova-compute[75307]:   <os>
Nov 13 23:42:55 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:42:55 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:42:55 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:42:55 user nova-compute[75307]:   </os>
Nov 13 23:42:55 user nova-compute[75307]:   <features>
Nov 13 23:42:55 user nova-compute[75307]:     <acpi/>
Nov 13 23:42:55 user nova-compute[75307]:     <apic/>
Nov 13 23:42:55 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:42:55 user nova-compute[75307]:   </features>
Nov 13 23:42:55 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:42:55 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:42:55 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:42:55 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:42:55 user nova-compute[75307]:   </clock>
Nov 13 23:42:55 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:42:55 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:42:55 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:42:55 user nova-compute[75307]:   </cpu>
Nov 13 23:42:55 user nova-compute[75307]:   <devices>
Nov 13 23:42:55 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:42:55 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:42:55 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk"/>
Nov 13 23:42:55 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:42:55 user nova-compute[75307]:     </disk>
Nov 13 23:42:55 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:42:55 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:42:55 user nova-compute[75307]:       <source dev="/dev/sdc"/>
Nov 13 23:42:55 user nova-compute[75307]:       <target dev="vdc" bus="virtio"/>
Nov 13 23:42:55 user nova-compute[75307]:       <serial>e5909d87-b4e5-4530-8cd1-a68a6174d988</serial>
Nov 13 23:42:55 user nova-compute[75307]:     </disk>
Nov 13 23:42:55 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:42:55 user nova-compute[75307]:       <mac address="fa:16:3e:1e:21:e4"/>
Nov 13 23:42:55 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:42:55 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:42:55 user nova-compute[75307]:       <target dev="tapfebdd6d8-9b"/>
Nov 13 23:42:55 user nova-compute[75307]:     </interface>
Nov 13 23:42:55 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:42:55 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/console.log" append="off"/>
Nov 13 23:42:55 user nova-compute[75307]:     </serial>
Nov 13 23:42:55 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:42:55 user nova-compute[75307]:     <video>
Nov 13 23:42:55 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:42:55 user nova-compute[75307]:     </video>
Nov 13 23:42:55 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:42:55 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:42:55 user nova-compute[75307]:     </rng>
Nov 13 23:42:55 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:42:55 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:42:55 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:42:55 user nova-compute[75307]:     </memballoon>
Nov 13 23:42:55 user nova-compute[75307]:   </devices>
Nov 13 23:42:55 user nova-compute[75307]: </domain>
Nov 13 23:42:55 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='0bd46600-4f0c-4c0b-842f-bf6406870c71',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-140235525',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:39:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:40:55.671774',shelved_host='user',shelved_image_id='0bd46600-4f0c-4c0b-842f-bf6406870c71'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:42:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG os_vif [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '429fabff-1274-5534-8e20-c467e58104ca', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfebdd6d8-9b, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfebdd6d8-9b, col_values=(('qos', UUID('87025985-194c-4f90-92a4-d508d6389f2e')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfebdd6d8-9b, col_values=(('external_ids', {'iface-id': 'febdd6d8-9bb4-4d70-80c6-880c48e5db09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1e:21:e4', 'vm-uuid': '76cf692b-48a2-4db6-8d81-7c82a2678fad'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:55 user nova-compute[75307]: INFO os_vif [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b')
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:42:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No VIF found with MAC fa:16:3e:1e:21:e4, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:42:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:57 user nova-compute[75307]: WARNING nova.compute.manager [req-8d498776-e6fa-4adc-b7cb-c642eb75c832 req-68ce0fa8-76fc-459a-bdc1-070570fc0401 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 23:42:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:42:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:42:58 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:42:58 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance spawned successfully.
Nov 13 23:42:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:42:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:42:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:42:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:42:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:42:59 user nova-compute[75307]: WARNING nova.compute.manager [req-3ebf5c29-a383-4ca1-8c08-a08c6813da6b req-01b0d1bb-1697-4b8f-aa8a-67c3a0697bee service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 23:42:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:42:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-7e41cf2c-420e-43c5-b55a-4af4c2438fa1 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.875s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:23 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:43:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:43:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:43:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:43:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updating instance_info_cache with network_info: [{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:43:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:43:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:43:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:25 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:43:26 user nova-compute[75307]: INFO nova.compute.claims [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Claim successful on node user
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.319s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:43:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.policy [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc3353c1e9114f74b7576c890e6f8388', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd3d1fd6aba1c42e7aa06378fe5b4f6a8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:43:26 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Creating image(s)
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "/opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "/opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:26 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk 1073741824" returned: 0 in 0.057s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Successfully created port: 7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Cannot resize image /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Ensure instance console log exists: /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Successfully updated port: 7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquired lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:43:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-changed-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Refreshing instance network info cache due to event network-changed-7a2020ea-2048-41e7-a054-60be03cf537c. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] Acquiring lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Updating instance_info_cache with network_info: [{"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Releasing lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Instance network_info: |[{"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] Acquired lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.neutron [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Refreshing network info cache for port 7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Start _get_guest_xml network_info=[{"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:43:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:43:28 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1506682494',display_name='tempest-VolumesActionsTest-instance-1506682494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1506682494',id=47,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3d1fd6aba1c42e7aa06378fe5b4f6a8',ramdisk_id='',reservation_id='r-sjhphqoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1359491915',owner_user_name='tempest-VolumesActionsTest-1359491915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:43:27Z,user_data=None,user_id='bc3353c1e9114f74b7576c890e6f8388',uuid=9a9d4b29-711c-465e-8f19-578e2a327f1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converting VIF {"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a9d4b29-711c-465e-8f19-578e2a327f1d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:43:28 user nova-compute[75307]:   <uuid>9a9d4b29-711c-465e-8f19-578e2a327f1d</uuid>
Nov 13 23:43:28 user nova-compute[75307]:   <name>instance-0000002f</name>
Nov 13 23:43:28 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:43:28 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:43:28 user nova-compute[75307]:   <metadata>
Nov 13 23:43:28 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:43:28 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:name>tempest-VolumesActionsTest-instance-1506682494</nova:name>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:43:28</nova:creationTime>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:43:28 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:43:28 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:owner>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:user uuid="bc3353c1e9114f74b7576c890e6f8388">tempest-VolumesActionsTest-1359491915-project-member</nova:user>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:project uuid="d3d1fd6aba1c42e7aa06378fe5b4f6a8">tempest-VolumesActionsTest-1359491915</nova:project>
Nov 13 23:43:28 user nova-compute[75307]:       </nova:owner>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:43:28 user nova-compute[75307]:       <nova:ports>
Nov 13 23:43:28 user nova-compute[75307]:         <nova:port uuid="7a2020ea-2048-41e7-a054-60be03cf537c">
Nov 13 23:43:28 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 23:43:28 user nova-compute[75307]:         </nova:port>
Nov 13 23:43:28 user nova-compute[75307]:       </nova:ports>
Nov 13 23:43:28 user nova-compute[75307]:     </nova:instance>
Nov 13 23:43:28 user nova-compute[75307]:   </metadata>
Nov 13 23:43:28 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:43:28 user nova-compute[75307]:     <system>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="serial">9a9d4b29-711c-465e-8f19-578e2a327f1d</entry>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="uuid">9a9d4b29-711c-465e-8f19-578e2a327f1d</entry>
Nov 13 23:43:28 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:43:28 user nova-compute[75307]:     </system>
Nov 13 23:43:28 user nova-compute[75307]:   </sysinfo>
Nov 13 23:43:28 user nova-compute[75307]:   <os>
Nov 13 23:43:28 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:43:28 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:43:28 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:43:28 user nova-compute[75307]:   </os>
Nov 13 23:43:28 user nova-compute[75307]:   <features>
Nov 13 23:43:28 user nova-compute[75307]:     <acpi/>
Nov 13 23:43:28 user nova-compute[75307]:     <apic/>
Nov 13 23:43:28 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:43:28 user nova-compute[75307]:   </features>
Nov 13 23:43:28 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:43:28 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:43:28 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:43:28 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:43:28 user nova-compute[75307]:   </clock>
Nov 13 23:43:28 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:43:28 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:43:28 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:43:28 user nova-compute[75307]:   </cpu>
Nov 13 23:43:28 user nova-compute[75307]:   <devices>
Nov 13 23:43:28 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:43:28 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:43:28 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk"/>
Nov 13 23:43:28 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:43:28 user nova-compute[75307]:     </disk>
Nov 13 23:43:28 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:43:28 user nova-compute[75307]:       <mac address="fa:16:3e:ea:d7:bf"/>
Nov 13 23:43:28 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:43:28 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:43:28 user nova-compute[75307]:       <target dev="tap7a2020ea-20"/>
Nov 13 23:43:28 user nova-compute[75307]:     </interface>
Nov 13 23:43:28 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:43:28 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/console.log" append="off"/>
Nov 13 23:43:28 user nova-compute[75307]:     </serial>
Nov 13 23:43:28 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:43:28 user nova-compute[75307]:     <video>
Nov 13 23:43:28 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:43:28 user nova-compute[75307]:     </video>
Nov 13 23:43:28 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:43:28 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:43:28 user nova-compute[75307]:     </rng>
Nov 13 23:43:28 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:43:28 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:43:28 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:43:28 user nova-compute[75307]:     </memballoon>
Nov 13 23:43:28 user nova-compute[75307]:   </devices>
Nov 13 23:43:28 user nova-compute[75307]: </domain>
Nov 13 23:43:28 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1506682494',display_name='tempest-VolumesActionsTest-instance-1506682494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1506682494',id=47,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d3d1fd6aba1c42e7aa06378fe5b4f6a8',ramdisk_id='',reservation_id='r-sjhphqoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1359491915',owner_user_name='tempest-VolumesActionsTest-1359491915-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:43:27Z,user_data=None,user_id='bc3353c1e9114f74b7576c890e6f8388',uuid=9a9d4b29-711c-465e-8f19-578e2a327f1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converting VIF {"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG os_vif [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '150a73b1-6c1e-59b2-9b3d-a39a695c905f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a2020ea-20, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7a2020ea-20, col_values=(('qos', UUID('7f0c0b0c-20d3-47e9-8f6d-468f4faae8cb')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7a2020ea-20, col_values=(('external_ids', {'iface-id': '7a2020ea-2048-41e7-a054-60be03cf537c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ea:d7:bf', 'vm-uuid': '9a9d4b29-711c-465e-8f19-578e2a327f1d'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:28 user nova-compute[75307]: INFO os_vif [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20')
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] No VIF found with MAC fa:16:3e:ea:d7:bf, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.neutron [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Updated VIF entry in instance network info cache for port 7a2020ea-2048-41e7-a054-60be03cf537c. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG nova.network.neutron [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Updating instance_info_cache with network_info: [{"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:43:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4dc986ac-a3a0-4f5b-8457-f376fdd2b77e req-af1024de-40cb-45af-a0a3-c2c0e34cbb95 service nova] Releasing lock "refresh_cache-9a9d4b29-711c-465e-8f19-578e2a327f1d" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:43:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG nova.compute.manager [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] No waiting events found dispatching network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:43:30 user nova-compute[75307]: WARNING nova.compute.manager [req-3c7b9b49-2949-4096-b992-61b0dabd8d6d req-83b584ce-cc51-4697-bce7-ea43ab32c418 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received unexpected event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c for instance with vm_state building and task_state spawning.
Nov 13 23:43:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:30 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:43:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Instance spawned successfully.
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:43:32 user nova-compute[75307]: INFO nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Took 5.13 seconds to spawn the instance on the hypervisor.
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] No waiting events found dispatching network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:43:32 user nova-compute[75307]: WARNING nova.compute.manager [req-d18c641b-ad0e-4202-ae88-23ad6628f7e6 req-b2de8b74-c698-469f-986c-23bf8b2a0d87 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received unexpected event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c for instance with vm_state active and task_state None.
Nov 13 23:43:32 user nova-compute[75307]: INFO nova.compute.manager [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Took 5.94 seconds to build instance.
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-60ad6b28-9342-4ed9-9fd1-58e790edb4ef tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.043s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:43:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:43:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8470MB free_disk=25.05581283569336GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 76cf692b-48a2-4db6-8d81-7c82a2678fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9a9d4b29-711c-465e-8f19-578e2a327f1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:43:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:33 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:43:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.359s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:43:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:43:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:17 user nova-compute[75307]: INFO nova.compute.manager [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Rescuing
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG nova.network.neutron [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating instance_info_cache with network_info: [{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:44:17 user nova-compute[75307]: WARNING nova.compute.manager [req-aeadb6c1-4bb2-4e13-89c3-5e7637afe8b5 req-fc3d500e-163d-4699-9972-09b3ae8cdf2b service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state rescuing.
Nov 13 23:44:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance destroyed successfully.
Nov 13 23:44:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Attempting a stable device rescue
Nov 13 23:44:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75307) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance directory exists: not creating {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 13 23:44:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Creating image(s)
Nov 13 23:44:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'trusted_certs' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG nova.virt.images [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] b0750e1d-3f23-421f-b4a0-894a154c400d was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.part /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.part /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.converted" returned: 0 in 0.235s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:44:19 user nova-compute[75307]: WARNING nova.compute.manager [req-daf02be3-1819-4ac8-8865-e623ee7f176a req-cea1e30e-6faf-490f-a91f-ef56bbb5fd1d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state rescuing.
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.598s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407 --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407,backing_fmt=raw /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407,backing_fmt=raw /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue" returned: 0 in 0.064s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "2cea8fde9e0cdabcd7960b34db449dad6983c407" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'migration_context' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<17b26140-038a-41c7-afb3-ba4b81758d16> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start _get_guest_xml network_info=[{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:14:fd:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b0750e1d-3f23-421f-b4a0-894a154c400d', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '17b26140-038a-41c7-afb3-ba4b81758d16', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'serial': 'cdbf76a4-f147-44ef-ba3a-6634fdd92a47'}, 'delete_on_termination': False, 'attachment_id': 'e1f520d4-c3eb-4a49-be8a-8dec3df30864', 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<17b26140-038a-41c7-afb3-ba4b81758d16> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'numa_topology' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<17b26140-038a-41c7-afb3-ba4b81758d16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:44:20 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:44:20 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'vcpu_model' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<17b26140-038a-41c7-afb3-ba4b81758d16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:44:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:44:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:44:20 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01c5c64-4b00-4a45-8df0-0746a15af9e1]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = QrPqVRfY\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 13 23:44:20 user nova-compute[75307]: node.name = iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47
Nov 13 23:44:20 user nova-compute[75307]: node.tpgt = -1
Nov 13 23:44:20 user nova-compute[75307]: node.startup = automatic
Nov 13 23:44:20 user nova-compute[75307]: node.leading_login = No
Nov 13 23:44:20 user nova-compute[75307]: iface.iscsi_ifacename = default
Nov 13 23:44:20 user nova-compute[75307]: iface.net_ifacename = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.ipaddress = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.prefix_len = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.hwaddress = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.transport_name = tcp
Nov 13 23:44:20 user nova-compute[75307]: iface.initiatorname = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.vlan_id = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.vlan_priority = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.vlan_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.iface_num = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.mtu = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.port = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.bootproto = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.subnet_mask = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.gateway = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_alt_client_id_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_alt_client_id = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_dns = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_learn_iqn = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_req_vendor_id_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_vendor_id_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_vendor_id = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.dhcp_slp_da = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.fragmentation = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.gratuitous_arp = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.incoming_forwarding = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.tos_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.tos = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.ttl = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.delayed_ack = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.tcp_nagle = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.tcp_wsf_state = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.tcp_wsf = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.tcp_timer_scale = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.tcp_timestamp = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.redirect = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.def_task_mgmt_timeout = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.header_digest = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.data_digest = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.immediate_data = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.initial_r2t = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.data_seq_inorder = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.data_pdu_inorder = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.erl = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.max_receive_data_len = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.first_burst_len = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.max_outstanding_r2t = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.max_burst_len = 0
Nov 13 23:44:20 user nova-compute[75307]: iface.chap_auth = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.bidi_chap = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.strict_login_compliance = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.discovery_auth = <empty>
Nov 13 23:44:20 user nova-compute[75307]: iface.discovery_logout = <empty>
Nov 13 23:44:20 user nova-compute[75307]: node.discovery_address = <empty>
Nov 13 23:44:20 user nova-compute[75307]: node.discovery_port = 0
Nov 13 23:44:20 user nova-compute[75307]: node.discovery_type = static
Nov 13 23:44:20 user nova-compute[75307]: node.session.initial_cmdsn = 0
Nov 13 23:44:20 user nova-compute[75307]: node.session.initial_login_retry_max = 8
Nov 13 23:44:20 user nova-compute[75307]: node.session.xmit_thread_priority = -20
Nov 13 23:44:20 user nova-compute[75307]: node.session.cmds_max = 128
Nov 13 23:44:20 user nova-compute[75307]: node.session.queue_depth = 32
Nov 13 23:44:20 user nova-compute[75307]: node.session.nr_sessions = 1
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.authmethod = CHAP
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.username = QrPqVRfY
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.password = ***
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.username_in = <empty>
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.password_in = <empty>
Nov 13 23:44:20 user nova-compute[75307]: node.session.auth.chap_algs = MD5
Nov 13 23:44:20 user nova-compute[75307]: node.session.timeo.replacement_timeout = 120
Nov 13 23:44:20 user nova-compute[75307]: node.session.err_timeo.abort_timeout = 15
Nov 13 23:44:20 user nova-compute[75307]: node.session.err_timeo.lu_reset_timeout = 30
Nov 13 23:44:20 user nova-compute[75307]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 13 23:44:20 user nova-compute[75307]: node.session.err_timeo.host_reset_timeout = 60
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.FastAbort = Yes
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.InitialR2T = No
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.ImmediateData = Yes
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.FirstBurstLength = 262144
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.MaxBurstLength = 16776192
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.DefaultTime2Retain = 0
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.DefaultTime2Wait = 2
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.MaxConnections = 1
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 13 23:44:20 user nova-compute[75307]: node.session.iscsi.ERL = 0
Nov 13 23:44:20 user nova-compute[75307]: node.session.scan = manual
Nov 13 23:44:20 user nova-compute[75307]: node.session.reopen_max = 0
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].address = 172.16.0.220
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].port = 3260
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].startup = manual
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].tcp.window_size = 524288
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].tcp.type_of_service = 0
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].timeo.logout_timeout = 15
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].timeo.login_timeout = 15
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].timeo.auth_timeout = 45
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].timeo.noop_out_interval = 5
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].timeo.noop_out_timeout = 5
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.HeaderDigest = None
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.DataDigest = None
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.IFMarker = No
Nov 13 23:44:20 user nova-compute[75307]: node.conn[0].iscsi.OFMarker = No
Nov 13 23:44:20 user nova-compute[75307]: # END RECORD
Nov 13 23:44:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d86dc5-0aac-439f-a8bd-b7072dc7ff48]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b190c30f-df24-4ade-bc54-29c7b6c34a52]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrPqVRfY {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QrPqVRfY" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ef5b43-319f-4670-bac6-1aa2c50fd3a9]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QrPqVRfY'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77429f5-7110-4086-abf8-dd502b6b3bbb]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e893872-e775-4b6b-ae6a-c217ac7d4db3]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:44:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.146s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] HCTL ('33', '0', '0', 0) found on session 56 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f94f114-8412-4bf0-94db-e634f3b1b355]: (4, ('0 0 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Searching for a device in session 56 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23839386437633866', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839386437633866', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2045005181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2045005181',id=46,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:42:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-1u2a4qqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:42:41Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=17b26140-038a-41c7-afb3-ba4b81758d16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:14:fd:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "vif_mac": "fa:16:3e:14:fd:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'pci_devices' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.objects.base [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Object Instance<17b26140-038a-41c7-afb3-ba4b81758d16> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:44:20 user nova-compute[75307]:   <uuid>17b26140-038a-41c7-afb3-ba4b81758d16</uuid>
Nov 13 23:44:20 user nova-compute[75307]:   <name>instance-0000002e</name>
Nov 13 23:44:20 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:44:20 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:44:20 user nova-compute[75307]:   <metadata>
Nov 13 23:44:20 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:44:20 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2045005181</nova:name>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:44:20</nova:creationTime>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:44:20 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:44:20 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:owner>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:user uuid="049e1cfffeef4a1996a661e5a3894ac1">tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member</nova:user>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:project uuid="324dfec822e6496d9601b2198091aa31">tempest-ServerBootFromVolumeStableRescueTest-29041052</nova:project>
Nov 13 23:44:20 user nova-compute[75307]:       </nova:owner>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:44:20 user nova-compute[75307]:       <nova:ports>
Nov 13 23:44:20 user nova-compute[75307]:         <nova:port uuid="0f0ab348-9946-4f3c-9bcf-c4dc2db06dde">
Nov 13 23:44:20 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:44:20 user nova-compute[75307]:         </nova:port>
Nov 13 23:44:20 user nova-compute[75307]:       </nova:ports>
Nov 13 23:44:20 user nova-compute[75307]:     </nova:instance>
Nov 13 23:44:20 user nova-compute[75307]:   </metadata>
Nov 13 23:44:20 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:44:20 user nova-compute[75307]:     <system>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="serial">17b26140-038a-41c7-afb3-ba4b81758d16</entry>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="uuid">17b26140-038a-41c7-afb3-ba4b81758d16</entry>
Nov 13 23:44:20 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:44:20 user nova-compute[75307]:     </system>
Nov 13 23:44:20 user nova-compute[75307]:   </sysinfo>
Nov 13 23:44:20 user nova-compute[75307]:   <os>
Nov 13 23:44:20 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:44:20 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:44:20 user nova-compute[75307]:   </os>
Nov 13 23:44:20 user nova-compute[75307]:   <features>
Nov 13 23:44:20 user nova-compute[75307]:     <acpi/>
Nov 13 23:44:20 user nova-compute[75307]:     <apic/>
Nov 13 23:44:20 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:44:20 user nova-compute[75307]:   </features>
Nov 13 23:44:20 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:44:20 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:44:20 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:44:20 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:44:20 user nova-compute[75307]:   </clock>
Nov 13 23:44:20 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:44:20 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:44:20 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:44:20 user nova-compute[75307]:   </cpu>
Nov 13 23:44:20 user nova-compute[75307]:   <devices>
Nov 13 23:44:20 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 13 23:44:20 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:44:20 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 13 23:44:20 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:44:20 user nova-compute[75307]:       <serial>cdbf76a4-f147-44ef-ba3a-6634fdd92a47</serial>
Nov 13 23:44:20 user nova-compute[75307]:     </disk>
Nov 13 23:44:20 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:44:20 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:44:20 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue"/>
Nov 13 23:44:20 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 13 23:44:20 user nova-compute[75307]:       <boot order="1"/>
Nov 13 23:44:20 user nova-compute[75307]:     </disk>
Nov 13 23:44:20 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:44:20 user nova-compute[75307]:       <mac address="fa:16:3e:14:fd:d8"/>
Nov 13 23:44:20 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:44:20 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:44:20 user nova-compute[75307]:       <target dev="tap0f0ab348-99"/>
Nov 13 23:44:20 user nova-compute[75307]:     </interface>
Nov 13 23:44:20 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:44:20 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/console.log" append="off"/>
Nov 13 23:44:20 user nova-compute[75307]:     </serial>
Nov 13 23:44:20 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:44:20 user nova-compute[75307]:     <video>
Nov 13 23:44:20 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:44:20 user nova-compute[75307]:     </video>
Nov 13 23:44:20 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:44:20 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:44:20 user nova-compute[75307]:     </rng>
Nov 13 23:44:20 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:44:20 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:44:20 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:44:20 user nova-compute[75307]:     </memballoon>
Nov 13 23:44:20 user nova-compute[75307]:   </devices>
Nov 13 23:44:20 user nova-compute[75307]: </domain>
Nov 13 23:44:20 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:44:20 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance destroyed successfully.
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:44:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] No VIF found with MAC fa:16:3e:14:fd:d8, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:44:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:44:22 user nova-compute[75307]: WARNING nova.compute.manager [req-38a26500-213c-49c1-96db-4f71d6ae1b34 req-f8bc0c9c-ab2f-4648-a87b-a0be3e626ae0 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state rescuing.
Nov 13 23:44:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-719903b9-d9e7-4375-a98d-fd1aec7b7346 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:44:24 user nova-compute[75307]: WARNING nova.compute.manager [req-97681913-6361-4fb5-80be-4032e957156b req-096bb7a7-94fc-4f5b-b5c6-33182f4c0556 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state rescuing.
Nov 13 23:44:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:44:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:44:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:33 user nova-compute[75307]: INFO nova.compute.manager [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Detaching volume e5909d87-b4e5-4530-8cd1-a68a6174d988
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:34 user nova-compute[75307]: INFO nova.virt.block_device [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Attempting to driver detach volume e5909d87-b4e5-4530-8cd1-a68a6174d988 from mountpoint /dev/vdc
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Attempting to detach device vdc from instance 76cf692b-48a2-4db6-8d81-7c82a2678fad from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:44:34 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:44:34 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:44:34 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:44:34 user nova-compute[75307]:   <serial>e5909d87-b4e5-4530-8cd1-a68a6174d988</serial>
Nov 13 23:44:34 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:44:34 user nova-compute[75307]: </disk>
Nov 13 23:44:34 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:44:34 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully detached device vdc from instance 76cf692b-48a2-4db6-8d81-7c82a2678fad from the persistent domain config.
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 76cf692b-48a2-4db6-8d81-7c82a2678fad from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] detach device xml: <disk type="block" device="disk">
Nov 13 23:44:34 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 13 23:44:34 user nova-compute[75307]:   <source dev="/dev/sdc"/>
Nov 13 23:44:34 user nova-compute[75307]:   <target dev="vdc" bus="virtio"/>
Nov 13 23:44:34 user nova-compute[75307]:   <serial>e5909d87-b4e5-4530-8cd1-a68a6174d988</serial>
Nov 13 23:44:34 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 13 23:44:34 user nova-compute[75307]: </disk>
Nov 13 23:44:34 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 13 23:44:34 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:44:34 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:44:34 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8489MB free_disk=24.93191146850586GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:44:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 76cf692b-48a2-4db6-8d81-7c82a2678fad actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 9a9d4b29-711c-465e-8f19-578e2a327f1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:44:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:44:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:54 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 76cf692b-48a2-4db6-8d81-7c82a2678fad is timed out.
Nov 13 23:44:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully detached device vdc from instance 76cf692b-48a2-4db6-8d81-7c82a2678fad from the live domain config.
Nov 13 23:44:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vuVOxjtX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:44:54 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8b43ed-8529-4cb1-9c7d-9bece1f27084]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:44:54 user nova-compute[75307]: No targets found.
Nov 13 23:44:54 user nova-compute[75307]: iSNS:
Nov 13 23:44:54 user nova-compute[75307]: No targets found.
Nov 13 23:44:54 user nova-compute[75307]: STATIC:
Nov 13 23:44:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988
Nov 13 23:44:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:44:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:44:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:44:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:44:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:44:54 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47
Nov 13 23:44:54 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:44:54 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:44:54 user nova-compute[75307]: FIRMWARE:
Nov 13 23:44:54 user nova-compute[75307]: No targets found.
Nov 13 23:44:54 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:44:54 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:44:54 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[da525607-d3e1-427f-8d7d-d8c150164f8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4001cc1-00ee-40dd-959c-b54a5a9a8dc8]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 (non-flash)
Nov 13 23:44:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c6cca60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988'): ({'sdc'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Removing single pathed devices sdc {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[15669dc3-cbf8-4179-87cc-90141d20241b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdc2e6ec-5fde-4f45-ad28-56ebc90f88f0]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flushing IO for device /dev/sdc {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faee7c1-7626-4712-8f65-fb558bfaa027]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a718cc-4da6-48a4-9eb1-1da54284e22e]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] SCSI volumes sdc have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1f45af-4fe4-4963-9897-946b654f6a92]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0c961c-3947-4c8a-82ce-e6479a41e71b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260]
Nov 13 23:44:55 user nova-compute[75307]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988, portal: 172.16.0.220,3260] successful.
Nov 13 23:44:55 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5909d87-b4e5-4530-8cd1-a68a6174d988 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f324c2-7132-470a-ba08-0f1d2534cd9c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] <== disconnect_volume: return (311ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG nova.objects.instance [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'flavor' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:44:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-48277107-55a9-41ab-872a-329bbaf17c03 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:44:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:44:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:20 user nova-compute[75307]: INFO nova.compute.manager [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Terminating instance
Nov 13 23:45:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-unplugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] No waiting events found dispatching network-vif-unplugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-085d5798-487b-485d-8259-7f7226d7246e req-72fb0b7f-0851-412b-9bc8-5ccd024b0966 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-unplugged-7a2020ea-2048-41e7-a054-60be03cf537c for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:45:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Instance destroyed successfully.
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lazy-loading 'resources' on Instance uuid 9a9d4b29-711c-465e-8f19-578e2a327f1d {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:43:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1506682494',display_name='tempest-VolumesActionsTest-instance-1506682494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1506682494',id=47,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:43:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d3d1fd6aba1c42e7aa06378fe5b4f6a8',ramdisk_id='',reservation_id='r-sjhphqoc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1359491915',owner_user_name='tempest-VolumesActionsTest-1359491915-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:43:32Z,user_data=None,user_id='bc3353c1e9114f74b7576c890e6f8388',uuid=9a9d4b29-711c-465e-8f19-578e2a327f1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converting VIF {"id": "7a2020ea-2048-41e7-a054-60be03cf537c", "address": "fa:16:3e:ea:d7:bf", "network": {"id": "01e69cd9-616b-4b8f-b28b-3375d85b6ee0", "bridge": "br-int", "label": "tempest-VolumesActionsTest-971995559-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d3d1fd6aba1c42e7aa06378fe5b4f6a8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a2020ea-20", "ovs_interfaceid": "7a2020ea-2048-41e7-a054-60be03cf537c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG os_vif [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a2020ea-20, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f0c0b0c-20d3-47e9-8f6d-468f4faae8cb) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:21 user nova-compute[75307]: INFO os_vif [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ea:d7:bf,bridge_name='br-int',has_traffic_filtering=True,id=7a2020ea-2048-41e7-a054-60be03cf537c,network=Network(01e69cd9-616b-4b8f-b28b-3375d85b6ee0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a2020ea-20')
Nov 13 23:45:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Deleting instance files /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d_del
Nov 13 23:45:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Deletion of /opt/stack/data/nova/instances/9a9d4b29-711c-465e-8f19-578e2a327f1d_del complete
Nov 13 23:45:21 user nova-compute[75307]: INFO nova.compute.manager [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 13 23:45:21 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:45:21 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:45:21 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Took 0.44 seconds to deallocate network for instance.
Nov 13 23:45:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:22 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:45:22 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:45:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.236s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:22 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Deleted allocations for instance 9a9d4b29-711c-465e-8f19-578e2a327f1d
Nov 13 23:45:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d51a6531-17b2-47c6-9f1d-b95cd50116e9 tempest-VolumesActionsTest-1359491915 tempest-VolumesActionsTest-1359491915-project-member] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.587s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:22 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] Acquiring lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] Lock "9a9d4b29-711c-465e-8f19-578e2a327f1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] No waiting events found dispatching network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:45:23 user nova-compute[75307]: WARNING nova.compute.manager [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received unexpected event network-vif-plugged-7a2020ea-2048-41e7-a054-60be03cf537c for instance with vm_state deleted and task_state None.
Nov 13 23:45:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6629d84-e1d7-4796-94b4-7dd5378651b5 req-4e9e0d31-fe25-4c0b-a01b-d312e11b94e6 service nova] [instance: 9a9d4b29-711c-465e-8f19-578e2a327f1d] Received event network-vif-deleted-7a2020ea-2048-41e7-a054-60be03cf537c {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:24 user nova-compute[75307]: INFO nova.compute.manager [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Terminating instance
Nov 13 23:45:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:45:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-a944871d-c0ed-4584-9bf1-018ff839500f req-734996e3-74da-461a-ada8-fd653ea8ae63 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-unplugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:45:24 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Instance destroyed successfully.
Nov 13 23:45:24 user nova-compute[75307]: DEBUG nova.objects.instance [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'resources' on Instance uuid 76cf692b-48a2-4db6-8d81-7c82a2678fad {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-614165099',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-614165099',id=43,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5B94VWw6po+HawKe7jlIH8Bz4MjMGA1B0hFH+wk7kgvCn5zvf9xqxXYLRkvA4VPQRMKxa5RchxvrtusS7ZvJy35P+TLjgGn/ZRa82yJ/IVjtUqW3As4iZm49q1YN2KNg==',key_name='tempest-keypair-140235525',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:42:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-vo7hyv2f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:42:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=76cf692b-48a2-4db6-8d81-7c82a2678fad,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "address": "fa:16:3e:1e:21:e4", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfebdd6d8-9b", "ovs_interfaceid": "febdd6d8-9bb4-4d70-80c6-880c48e5db09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG os_vif [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfebdd6d8-9b, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87025985-194c-4f90-92a4-d508d6389f2e) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:25 user nova-compute[75307]: INFO os_vif [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1e:21:e4,bridge_name='br-int',has_traffic_filtering=True,id=febdd6d8-9bb4-4d70-80c6-880c48e5db09,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfebdd6d8-9b')
Nov 13 23:45:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Deleting instance files /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad_del
Nov 13 23:45:25 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Deletion of /opt/stack/data/nova/instances/76cf692b-48a2-4db6-8d81-7c82a2678fad_del complete
Nov 13 23:45:25 user nova-compute[75307]: INFO nova.compute.manager [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 13 23:45:25 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:45:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:45:26 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Took 1.04 seconds to deallocate network for instance.
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-b366b4f8-98a0-48b6-b41b-fdfcaccb862a req-2087f75f-79ea-47a1-91ac-e7ee85435445 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-deleted-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:26 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Deleted allocations for instance 76cf692b-48a2-4db6-8d81-7c82a2678fad
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-395b06ea-f190-4539-a73b-bf4894808aae tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] Acquiring lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] Lock "76cf692b-48a2-4db6-8d81-7c82a2678fad-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] No waiting events found dispatching network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:45:26 user nova-compute[75307]: WARNING nova.compute.manager [req-5ed55ed4-6903-49d5-b090-ac4d9bad3d19 req-e25b7139-3584-4b16-8b6d-60234cfb6e97 service nova] [instance: 76cf692b-48a2-4db6-8d81-7c82a2678fad] Received unexpected event network-vif-plugged-febdd6d8-9bb4-4d70-80c6-880c48e5db09 for instance with vm_state deleted and task_state None.
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:45:26 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:45:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:45:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:45:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:45:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:45:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:45:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:45:35 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8618MB free_disk=24.985370635986328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:45:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:45:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:45:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:45:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:45:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:45:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:45:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:45:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:46:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:07 user nova-compute[75307]: INFO nova.compute.manager [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Unrescuing
Nov 13 23:46:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:46:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquired lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:46:07 user nova-compute[75307]: DEBUG nova.network.neutron [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG nova.network.neutron [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating instance_info_cache with network_info: [{"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Releasing lock "refresh_cache-17b26140-038a-41c7-afb3-ba4b81758d16" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'flavor' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:08 user nova-compute[75307]: DEBUG nova.compute.manager [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:08 user nova-compute[75307]: WARNING nova.compute.manager [req-8f2bc5da-b16b-4e0d-8c94-5d55828b0d98 req-234ad240-399f-46ce-b0b6-ee0b53730ea9 service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:46:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:09 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance destroyed successfully.
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:10 user nova-compute[75307]: WARNING nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:10 user nova-compute[75307]: WARNING nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:10 user nova-compute[75307]: DEBUG nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:10 user nova-compute[75307]: WARNING nova.compute.manager [req-5f6eb7df-a4b5-4547-a55d-ca93e8093d4f req-6c271316-01fd-4d62-b5f6-2f1e7cf93b3d service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state rescued and task_state unrescuing.
Nov 13 23:46:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-02575efd-52a7-4cec-b4de-2b5db8b6e691 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:46:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:46:18 user nova-compute[75307]: INFO nova.compute.claims [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Claim successful on node user
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.284s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:46:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.policy [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2709ea16f7b6424a9c67107096249c3e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b267b7151e414c9180bc7c8e5accd6de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:46:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Creating image(s)
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:18 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk 1073741824" returned: 0 in 0.051s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Successfully created port: b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Cannot resize image /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Successfully updated port: b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing instance network info cache due to event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:46:19 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.neutron [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance network_info: |[{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start _get_guest_xml network_info=[{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:46:20 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:46:20 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOlGTTIcCjipt2cxK6TlY4eJbO0xUXE9tx5NIsTvCVle7eev8k+K59/BC8LXDKMevh0AfhIBTA01NX4OpEOLGIYLQwWW6COHyMy0mAvVkTgP2NqWGy4ekBCs4Xl/M4zYQ==',key_name='tempest-keypair-537426490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.objects.instance [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_devices' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:46:20 user nova-compute[75307]:   <uuid>c54af9a8-e11d-4d67-a25d-ba916c43f2a3</uuid>
Nov 13 23:46:20 user nova-compute[75307]:   <name>instance-00000030</name>
Nov 13 23:46:20 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:46:20 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:46:20 user nova-compute[75307]:   <metadata>
Nov 13 23:46:20 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:46:20 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-930756203</nova:name>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:46:20</nova:creationTime>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:46:20 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:46:20 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:owner>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:user uuid="2709ea16f7b6424a9c67107096249c3e">tempest-AttachVolumeShelveTestJSON-620800295-project-member</nova:user>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:project uuid="b267b7151e414c9180bc7c8e5accd6de">tempest-AttachVolumeShelveTestJSON-620800295</nova:project>
Nov 13 23:46:20 user nova-compute[75307]:       </nova:owner>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:46:20 user nova-compute[75307]:       <nova:ports>
Nov 13 23:46:20 user nova-compute[75307]:         <nova:port uuid="b14184ae-685c-4a0f-9f46-5e2cb47fcf9a">
Nov 13 23:46:20 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:46:20 user nova-compute[75307]:         </nova:port>
Nov 13 23:46:20 user nova-compute[75307]:       </nova:ports>
Nov 13 23:46:20 user nova-compute[75307]:     </nova:instance>
Nov 13 23:46:20 user nova-compute[75307]:   </metadata>
Nov 13 23:46:20 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:46:20 user nova-compute[75307]:     <system>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="serial">c54af9a8-e11d-4d67-a25d-ba916c43f2a3</entry>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="uuid">c54af9a8-e11d-4d67-a25d-ba916c43f2a3</entry>
Nov 13 23:46:20 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:46:20 user nova-compute[75307]:     </system>
Nov 13 23:46:20 user nova-compute[75307]:   </sysinfo>
Nov 13 23:46:20 user nova-compute[75307]:   <os>
Nov 13 23:46:20 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:46:20 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:46:20 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:46:20 user nova-compute[75307]:   </os>
Nov 13 23:46:20 user nova-compute[75307]:   <features>
Nov 13 23:46:20 user nova-compute[75307]:     <acpi/>
Nov 13 23:46:20 user nova-compute[75307]:     <apic/>
Nov 13 23:46:20 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:46:20 user nova-compute[75307]:   </features>
Nov 13 23:46:20 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:46:20 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:46:20 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:46:20 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:46:20 user nova-compute[75307]:   </clock>
Nov 13 23:46:20 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:46:20 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:46:20 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:46:20 user nova-compute[75307]:   </cpu>
Nov 13 23:46:20 user nova-compute[75307]:   <devices>
Nov 13 23:46:20 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:46:20 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:46:20 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk"/>
Nov 13 23:46:20 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:46:20 user nova-compute[75307]:     </disk>
Nov 13 23:46:20 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:46:20 user nova-compute[75307]:       <mac address="fa:16:3e:00:9e:63"/>
Nov 13 23:46:20 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:46:20 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:46:20 user nova-compute[75307]:       <target dev="tapb14184ae-68"/>
Nov 13 23:46:20 user nova-compute[75307]:     </interface>
Nov 13 23:46:20 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:46:20 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/console.log" append="off"/>
Nov 13 23:46:20 user nova-compute[75307]:     </serial>
Nov 13 23:46:20 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:46:20 user nova-compute[75307]:     <video>
Nov 13 23:46:20 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:46:20 user nova-compute[75307]:     </video>
Nov 13 23:46:20 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:46:20 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:46:20 user nova-compute[75307]:     </rng>
Nov 13 23:46:20 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:46:20 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:46:20 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:46:20 user nova-compute[75307]:     </memballoon>
Nov 13 23:46:20 user nova-compute[75307]:   </devices>
Nov 13 23:46:20 user nova-compute[75307]: </domain>
Nov 13 23:46:20 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOlGTTIcCjipt2cxK6TlY4eJbO0xUXE9tx5NIsTvCVle7eev8k+K59/BC8LXDKMevh0AfhIBTA01NX4OpEOLGIYLQwWW6COHyMy0mAvVkTgP2NqWGy4ekBCs4Xl/M4zYQ==',key_name='tempest-keypair-537426490',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:46:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG os_vif [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23744a36-6ef0-5ccb-a8a6-1f3576c9b51a', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14184ae-68, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14184ae-68, col_values=(('qos', UUID('7260e284-72bc-4f02-a964-96dc1ea43097')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14184ae-68, col_values=(('external_ids', {'iface-id': 'b14184ae-685c-4a0f-9f46-5e2cb47fcf9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:9e:63', 'vm-uuid': 'c54af9a8-e11d-4d67-a25d-ba916c43f2a3'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:20 user nova-compute[75307]: INFO os_vif [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68')
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No VIF found with MAC fa:16:3e:00:9e:63, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updated VIF entry in instance network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG nova.network.neutron [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:46:20 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-eb574dbe-13d6-4610-ad37-542bcd2c7e26 req-b85adc4f-7e90-42aa-9d1b-293950e59036 service nova] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:46:21 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:22 user nova-compute[75307]: WARNING nova.compute.manager [req-3d5d5d66-6133-4dc7-a77e-362f613db7bc req-fee8a3fb-21a9-4481-8d08-ef7605e895c6 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state building and task_state spawning.
Nov 13 23:46:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:46:24 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance spawned successfully.
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:46:24 user nova-compute[75307]: INFO nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:46:24 user nova-compute[75307]: INFO nova.compute.manager [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Took 6.11 seconds to build instance.
Nov 13 23:46:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-79def1d1-150a-407d-8803-372bce491a14 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.211s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:46:24 user nova-compute[75307]: WARNING nova.compute.manager [req-e6ef623b-6ca0-4757-b098-fd7f912bf627 req-c765a64e-6211-4ec2-9181-68f4a1c3e76d service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state active and task_state None.
Nov 13 23:46:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:46:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:46:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:46:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [{"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-3ea4d239-785b-4a80-9cfc-b8ac078c644f" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:46:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:35 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:46:36 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:46:36 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8535MB free_disk=24.98310089111328GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:46:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:46:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:46:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:46:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:26 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:26 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:47:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:47:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:47:26 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:47:27 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updating instance_info_cache with network_info: [{"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:47:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f8798e24-93a8-4aa0-a54e-00fc39cf69d4" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:47:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:47:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:47:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:38 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:47:38 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8542MB free_disk=24.944007873535156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 17b26140-038a-41c7-afb3-ba4b81758d16 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:47:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:47:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:47:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:47:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:47:58 user nova-compute[75307]: INFO nova.compute.manager [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Terminating instance
Nov 13 23:47:58 user nova-compute[75307]: DEBUG nova.compute.manager [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-3d2b4b7e-302a-427c-a104-5545c44da21a req-dd9afcb4-b27d-4816-9553-b1063a44d27a service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Instance destroyed successfully.
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.objects.instance [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid 17b26140-038a-41c7-afb3-ba4b81758d16 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:42:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2045005181',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2045005181',id=46,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:44:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-1u2a4qqa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:46:12Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=17b26140-038a-41c7-afb3-ba4b81758d16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "address": "fa:16:3e:14:fd:d8", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f0ab348-99", "ovs_interfaceid": "0f0ab348-9946-4f3c-9bcf-c4dc2db06dde", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_vif [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f0ab348-99, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da7bea6c-c9e0-4174-9e13-4884be619b7e) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:47:59 user nova-compute[75307]: INFO os_vif [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:fd:d8,bridge_name='br-int',has_traffic_filtering=True,id=0f0ab348-9946-4f3c-9bcf-c4dc2db06dde,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f0ab348-99')
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QrPqVRfY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:47:59 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1186c4-2a4c-44fb-b39d-4d2f819a9b75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:47:59 user nova-compute[75307]: No targets found.
Nov 13 23:47:59 user nova-compute[75307]: iSNS:
Nov 13 23:47:59 user nova-compute[75307]: No targets found.
Nov 13 23:47:59 user nova-compute[75307]: STATIC:
Nov 13 23:47:59 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:47:59 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:47:59 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:47:59 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47
Nov 13 23:47:59 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:47:59 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:47:59 user nova-compute[75307]: FIRMWARE:
Nov 13 23:47:59 user nova-compute[75307]: No targets found.
Nov 13 23:47:59 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:47:59 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:47:59 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1311f0bc-2d0b-4b1d-8117-c21e013806f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab3449-d841-41eb-9e29-411a283dd4af]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:47:59 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:47:59 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:47:59 user nova-compute[75307]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 (non-flash)
Nov 13 23:47:59 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c62a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7794813d-7af2-42cd-ab88-9d924e1d0ccd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[60bbe764-caed-448c-bd16-ef9aab2b67db]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c5b5c3-5a80-452b-aed9-a00d0a143105]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.103s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4369b55f-03ae-49dc-8ebd-1155f932c5f7]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ccbb40e-e600-4612-b55c-c0654070e23f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c27937e-eab7-4d12-8c1c-fc94b59ebb86]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260]
Nov 13 23:47:59 user nova-compute[75307]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47, portal: 172.16.0.220,3260] successful.
Nov 13 23:47:59 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbf76a4-f147-44ef-ba3a-6634fdd92a47 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbf923b-e0d7-4e57-81d1-2cfcd04e7f5c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== disconnect_volume: return (369ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:47:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Deleting instance files /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16_del
Nov 13 23:47:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Deletion of /opt/stack/data/nova/instances/17b26140-038a-41c7-afb3-ba4b81758d16_del complete
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:47:59 user nova-compute[75307]: INFO nova.compute.manager [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 13 23:47:59 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:47:59 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:48:00 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:48:00 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Took 0.53 seconds to deallocate network for instance.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:01 user nova-compute[75307]: WARNING nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state deleting.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:01 user nova-compute[75307]: WARNING nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state deleting.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:01 user nova-compute[75307]: WARNING nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state deleting.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-unplugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Acquiring lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] Lock "17b26140-038a-41c7-afb3-ba4b81758d16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] No waiting events found dispatching network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:01 user nova-compute[75307]: WARNING nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received unexpected event network-vif-plugged-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde for instance with vm_state active and task_state deleting.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-f9d3991f-0089-4352-a27f-0cec87a40bed req-8cb25be5-030f-4549-b6b8-1ab638d7b1eb service nova] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Received event network-vif-deleted-0f0ab348-9946-4f3c-9bcf-c4dc2db06dde {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:01 user nova-compute[75307]: INFO nova.compute.manager [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 17b26140-038a-41c7-afb3-ba4b81758d16] Took 0.88 seconds to detach 1 volumes for instance.
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.201s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:01 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Deleted allocations for instance 17b26140-038a-41c7-afb3-ba4b81758d16
Nov 13 23:48:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-eae979cd-35bd-4c7f-a6ca-1a1967e30304 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "17b26140-038a-41c7-afb3-ba4b81758d16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.012s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG nova.compute.manager [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing instance network info cache due to event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updated VIF entry in instance network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG nova.network.neutron [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:48:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4af7eb14-ebac-4da6-96ab-da21c7e50de0 req-2feb0d82-9460-4651-bc20-1597e890d183 service nova] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:11 user nova-compute[75307]: INFO nova.compute.manager [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Shelving
Nov 13 23:48:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:11 user nova-compute[75307]: WARNING nova.compute.manager [req-00225dd9-2ce6-4366-8956-8590b8042ca6 req-21267539-565a-42f9-b851-a2f4deb1016a service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state active and task_state shelving.
Nov 13 23:48:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance destroyed successfully.
Nov 13 23:48:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Beginning cold snapshot process
Nov 13 23:48:12 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:48:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk /opt/stack/data/nova/instances/snapshots/tmpqweid6tb/0a1f69a3586d41d4b76f97ca9be5c5f6 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk /opt/stack/data/nova/instances/snapshots/tmpqweid6tb/0a1f69a3586d41d4b76f97ca9be5c5f6" returned: 0 in 0.604s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:48:13 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Snapshot extracted, beginning image upload
Nov 13 23:48:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:13 user nova-compute[75307]: WARNING nova.compute.manager [req-982a42f2-1e1a-417e-8194-3c29ce4a314f req-a2845b71-c01b-41ca-8445-693da8d2e533 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state active and task_state shelving_image_uploading.
Nov 13 23:48:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Snapshot image upload complete
Nov 13 23:48:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:48:15 user nova-compute[75307]: INFO nova.compute.manager [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Shelve offloading
Nov 13 23:48:15 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance destroyed successfully.
Nov 13 23:48:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:48:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:48:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:48:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:48:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:48:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:48:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance destroyed successfully.
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'resources' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOlGTTIcCjipt2cxK6TlY4eJbO0xUXE9tx5NIsTvCVle7eev8k+K59/BC8LXDKMevh0AfhIBTA01NX4OpEOLGIYLQwWW6COHyMy0mAvVkTgP2NqWGy4ekBCs4Xl/M4zYQ==',key_name='tempest-keypair-537426490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:48:15.420752',shelved_host='user',shelved_image_id='1d367df4-54d6-4058-804d-730e017483ac'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG os_vif [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14184ae-68, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing instance network info cache due to event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.network.neutron [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7260e284-72bc-4f02-a964-96dc1ea43097) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:16 user nova-compute[75307]: INFO os_vif [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68')
Nov 13 23:48:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Deleting instance files /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3_del
Nov 13 23:48:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Deletion of /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3_del complete
Nov 13 23:48:16 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Deleted allocations for instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3
Nov 13 23:48:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.objects.instance [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'numa_topology' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:48:16 user nova-compute[75307]: DEBUG nova.objects.base [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<c54af9a8-e11d-4d67-a25d-ba916c43f2a3> lazy-loaded attributes: resources,numa_topology {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updated VIF entry in instance network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG nova.network.neutron [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb14184ae-68", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5779fa9c-cbcc-4175-a5c4-1dd2609ab914 req-63b7ac1e-c10a-4ce3-a09d-1f67f658f592 service nova] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:48:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-691769e9-4cf1-4ed3-b6a9-e584a1a4a4a9 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.489s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:48:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:48:27 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:48:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:48:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:48:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:48:37 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:48:37 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8782MB free_disk=24.921810150146484GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:48:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:48:38 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:48:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:48:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:48:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:48:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:49 user nova-compute[75307]: INFO nova.compute.manager [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Terminating instance
Nov 13 23:48:49 user nova-compute[75307]: DEBUG nova.compute.manager [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-unplugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] No waiting events found dispatching network-vif-unplugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG nova.compute.manager [req-4f3cb998-962e-47b8-97b8-757e22c2066d req-ea9e1849-4bee-4aff-90a5-79bde8cb0a57 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-unplugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Instance destroyed successfully.
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.objects.instance [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid f8798e24-93a8-4aa0-a54e-00fc39cf69d4 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-628874380',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-628874380',id=45,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0ncc2pyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:41:24Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f8798e24-93a8-4aa0-a54e-00fc39cf69d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "address": "fa:16:3e:d6:67:2b", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8add43b2-89", "ovs_interfaceid": "8add43b2-89df-46e6-b64b-0ce2ab1f7dbe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG os_vif [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8add43b2-89, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33c1d9c9-d065-4d9a-980b-63eec3d6bc7e) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:48:50 user nova-compute[75307]: INFO os_vif [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d6:67:2b,bridge_name='br-int',has_traffic_filtering=True,id=8add43b2-89df-46e6-b64b-0ce2ab1f7dbe,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8add43b2-89')
Nov 13 23:48:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Deleting instance files /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4_del
Nov 13 23:48:50 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Deletion of /opt/stack/data/nova/instances/f8798e24-93a8-4aa0-a54e-00fc39cf69d4_del complete
Nov 13 23:48:50 user nova-compute[75307]: INFO nova.compute.manager [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 13 23:48:50 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:48:50 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Took 0.47 seconds to deallocate network for instance.
Nov 13 23:48:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:51 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Deleted allocations for instance f8798e24-93a8-4aa0-a54e-00fc39cf69d4
Nov 13 23:48:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-b071b8dc-4689-4193-85ef-39aaede1152f tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.738s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] Acquiring lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] Lock "f8798e24-93a8-4aa0-a54e-00fc39cf69d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:48:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] No waiting events found dispatching network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:48:51 user nova-compute[75307]: WARNING nova.compute.manager [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received unexpected event network-vif-plugged-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe for instance with vm_state deleted and task_state None.
Nov 13 23:48:51 user nova-compute[75307]: DEBUG nova.compute.manager [req-aedaffd3-6efb-48de-872d-ff0a56fb5a27 req-ac6579ff-c657-4b72-bba3-f9383850cdd6 service nova] [instance: f8798e24-93a8-4aa0-a54e-00fc39cf69d4] Received event network-vif-deleted-8add43b2-89df-46e6-b64b-0ce2ab1f7dbe {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:48:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:49:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:49:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [{"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:49:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-f619c353-0802-4546-a6e3-4a9b1e89f084" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:49:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:49:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:49:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:36 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:37 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:49:37 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.046382904052734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:49:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.246s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:40 user nova-compute[75307]: INFO nova.compute.manager [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Terminating instance
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.compute.manager [req-c6252a91-e528-444d-ad06-49ee27b5d754 req-b2f99f02-625d-48b0-a55e-3bfb3314a700 service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-unplugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:40 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Instance destroyed successfully.
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid 3ea4d239-785b-4a80-9cfc-b8ac078c644f {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:33:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1264946595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1264946595',id=39,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:35:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-0irx37a6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:37:40Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=3ea4d239-785b-4a80-9cfc-b8ac078c644f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "02f43f2f-505a-4165-9510-37b6e163ed68", "address": "fa:16:3e:99:81:37", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02f43f2f-50", "ovs_interfaceid": "02f43f2f-505a-4165-9510-37b6e163ed68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_vif [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02f43f2f-50, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=460b750c-aeb5-4d98-b4b2-0c60e6940cae) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:40 user nova-compute[75307]: INFO os_vif [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:81:37,bridge_name='br-int',has_traffic_filtering=True,id=02f43f2f-505a-4165-9510-37b6e163ed68,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02f43f2f-50')
Nov 13 23:49:40 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rkvWcQsu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 13 23:49:40 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c9292b-b8f6-48e7-924f-3b033a10f884]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 13 23:49:40 user nova-compute[75307]: No targets found.
Nov 13 23:49:40 user nova-compute[75307]: iSNS:
Nov 13 23:49:40 user nova-compute[75307]: No targets found.
Nov 13 23:49:40 user nova-compute[75307]: STATIC:
Nov 13 23:49:40 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7
Nov 13 23:49:40 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 13 23:49:40 user nova-compute[75307]:                 Iface Name: default
Nov 13 23:49:40 user nova-compute[75307]: FIRMWARE:
Nov 13 23:49:40 user nova-compute[75307]: No targets found.
Nov 13 23:49:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 13 23:49:40 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 13 23:49:40 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e83f5de-4e50-41e6-88c1-f318489a27a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d85d4d6-4c9b-4c9e-b4ea-b4e45133ec43]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:49:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 (non-flash)
Nov 13 23:49:40 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3459f880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7'): ({'sdd'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Removing single pathed devices sdd {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec8e3f16-fe1b-4240-b6ff-92341840b090]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1887fe5-d8bf-4b38-8db8-0170f7b1ec1f]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Flushing IO for device /dev/sdd {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e7e514-5b45-47ac-85e9-afcfe8b5e409]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 13 23:49:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd69dd3-dce3-45d7-a5a7-3a7d297131d5]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] SCSI volumes sdd have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a71188-fd3f-4db0-a940-7345ef336baa]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a998075-148a-4b59-9a2e-4a85048484f6]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260]
Nov 13 23:49:41 user nova-compute[75307]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7, portal: 172.16.0.220,3260] successful.
Nov 13 23:49:41 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c6b8aca-f813-403b-b862-fe1b48c62be7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c9d1e-0992-415b-9992-07cf0b7abcdc]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] <== disconnect_volume: return (312ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 13 23:49:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Deleting instance files /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f_del
Nov 13 23:49:41 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Deletion of /opt/stack/data/nova/instances/3ea4d239-785b-4a80-9cfc-b8ac078c644f_del complete
Nov 13 23:49:41 user nova-compute[75307]: INFO nova.compute.manager [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 13 23:49:41 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:49:41 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Took 0.53 seconds to deallocate network for instance.
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.compute.manager [req-e56524f9-d050-4ba3-bc2e-3fa83e845f1b req-37a05039-355e-4b64-a267-1999a35adb0a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-deleted-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:49:41 user nova-compute[75307]: INFO nova.compute.manager [req-e56524f9-d050-4ba3-bc2e-3fa83e845f1b req-37a05039-355e-4b64-a267-1999a35adb0a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Neutron deleted interface 02f43f2f-505a-4165-9510-37b6e163ed68; detaching it from the instance and deleting it from the info cache
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.network.neutron [req-e56524f9-d050-4ba3-bc2e-3fa83e845f1b req-37a05039-355e-4b64-a267-1999a35adb0a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:49:41 user nova-compute[75307]: DEBUG nova.compute.manager [req-e56524f9-d050-4ba3-bc2e-3fa83e845f1b req-37a05039-355e-4b64-a267-1999a35adb0a service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Detach interface failed, port_id=02f43f2f-505a-4165-9510-37b6e163ed68, reason: Instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] Acquiring lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG nova.compute.manager [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] No waiting events found dispatching network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:49:42 user nova-compute[75307]: WARNING nova.compute.manager [req-53659d03-43aa-460c-b956-836d9a7371b0 req-c8b071c4-c54f-482a-a33b-99177c4025bf service nova] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Received unexpected event network-vif-plugged-02f43f2f-505a-4165-9510-37b6e163ed68 for instance with vm_state active and task_state deleting.
Nov 13 23:49:42 user nova-compute[75307]: INFO nova.compute.manager [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: 3ea4d239-785b-4a80-9cfc-b8ac078c644f] Took 0.70 seconds to detach 1 volumes for instance.
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:42 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Deleted allocations for instance 3ea4d239-785b-4a80-9cfc-b8ac078c644f
Nov 13 23:49:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-525d5542-a7fc-45c1-befe-d16fb8de32cd tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "3ea4d239-785b-4a80-9cfc-b8ac078c644f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.731s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:49:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Verify base images {{(pid=75307) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Image id dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7 yields fingerprint 5c24cbfcd83c19632f122847bd5d6fc51f4776dc {{(pid=75307) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] image dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7 at (/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc): checking
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] image dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7 at (/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc): image is in use {{(pid=75307) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75307) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] f619c353-0802-4546-a6e3-4a9b1e89f084 is a valid instance name {{(pid=75307) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] f619c353-0802-4546-a6e3-4a9b1e89f084 has a disk file {{(pid=75307) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance f619c353-0802-4546-a6e3-4a9b1e89f084 is backed by 5c24cbfcd83c19632f122847bd5d6fc51f4776dc {{(pid=75307) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee
Nov 13 23:49:54 user nova-compute[75307]: WARNING nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Active base files: /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Removable base files: /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0 /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/12fc4686594eec7200485ffa14d7ab175eea6a2b
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/c7b279bc872bb1bd40f3a7a8c2af532465bfd7d0
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3f464d4e91a9ee0469c8e09abede15b5cfe2eeff
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/3116d51acfae17d0c7b98f826374a1bfb8b6dfca
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/989f93d027fc9d10f0d31209bca4739718e96dee
Nov 13 23:49:54 user nova-compute[75307]: INFO nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2cea8fde9e0cdabcd7960b34db449dad6983c407
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Verification complete {{(pid=75307) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Verify swap images {{(pid=75307) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 13 23:49:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.imagecache [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Verify ephemeral images {{(pid=75307) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 13 23:49:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:04 user nova-compute[75307]: INFO nova.compute.manager [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Unshelving
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_requests' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'numa_topology' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:50:04 user nova-compute[75307]: INFO nova.compute.claims [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Claim successful on node user
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.245s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:04 user nova-compute[75307]: INFO nova.network.neutron [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:50:04 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing instance network info cache due to event network-changed-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.network.neutron [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:50:05 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Creating image(s)
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'trusted_certs' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.network.neutron [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Refreshing network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG nova.objects.base [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<c54af9a8-e11d-4d67-a25d-ba916c43f2a3> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.part --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG nova.virt.images [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] 1d367df4-54d6-4058-804d-730e017483ac was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.part /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updated VIF entry in instance network info cache for port b14184ae-685c-4a0f-9f46-5e2cb47fcf9a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:50:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ff551d84-37ea-407f-bb36-e172e1213347 req-0a455334-e07f-4a58-8b46-c4ede13412d1 service nova] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.part /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.converted" returned: 0 in 0.597s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.076s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833,backing_fmt=raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833,backing_fmt=raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk 1073741824" returned: 0 in 0.055s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "d55bdd571ac0d8c3498a36ea2a431597b3def833" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d55bdd571ac0d8c3498a36ea2a431597b3def833 --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'migration_context' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:08 user nova-compute[75307]: DEBUG nova.objects.base [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<c54af9a8-e11d-4d67-a25d-ba916c43f2a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:50:08 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Rebasing disk image.
Nov 13 23:50:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:08 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc -F raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc -F raw /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk" returned: 0 in 2.400s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start _get_guest_xml network_info=[{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='977ada6c307b2134f0a2c97701acddd4',container_format='bare',created_at=2023-11-13T23:48:12Z,direct_url=<?>,disk_format='qcow2',id=1d367df4-54d6-4058-804d-730e017483ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-930756203-shelved',owner='b267b7151e414c9180bc7c8e5accd6de',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T23:48:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:50:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:50:10 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='977ada6c307b2134f0a2c97701acddd4',container_format='bare',created_at=2023-11-13T23:48:12Z,direct_url=<?>,disk_format='qcow2',id=1d367df4-54d6-4058-804d-730e017483ac,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-930756203-shelved',owner='b267b7151e414c9180bc7c8e5accd6de',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-13T23:48:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'vcpu_model' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<c54af9a8-e11d-4d67-a25d-ba916c43f2a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='1d367df4-54d6-4058-804d-730e017483ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-537426490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:48:15.420752',shelved_host='user',shelved_image_id='1d367df4-54d6-4058-804d-730e017483ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'pci_devices' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.objects.base [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Object Instance<c54af9a8-e11d-4d67-a25d-ba916c43f2a3> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:50:10 user nova-compute[75307]:   <uuid>c54af9a8-e11d-4d67-a25d-ba916c43f2a3</uuid>
Nov 13 23:50:10 user nova-compute[75307]:   <name>instance-00000030</name>
Nov 13 23:50:10 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:50:10 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:50:10 user nova-compute[75307]:   <metadata>
Nov 13 23:50:10 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:50:10 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-930756203</nova:name>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:50:10</nova:creationTime>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:50:10 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:50:10 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:owner>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:user uuid="2709ea16f7b6424a9c67107096249c3e">tempest-AttachVolumeShelveTestJSON-620800295-project-member</nova:user>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:project uuid="b267b7151e414c9180bc7c8e5accd6de">tempest-AttachVolumeShelveTestJSON-620800295</nova:project>
Nov 13 23:50:10 user nova-compute[75307]:       </nova:owner>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:root type="image" uuid="1d367df4-54d6-4058-804d-730e017483ac"/>
Nov 13 23:50:10 user nova-compute[75307]:       <nova:ports>
Nov 13 23:50:10 user nova-compute[75307]:         <nova:port uuid="b14184ae-685c-4a0f-9f46-5e2cb47fcf9a">
Nov 13 23:50:10 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:50:10 user nova-compute[75307]:         </nova:port>
Nov 13 23:50:10 user nova-compute[75307]:       </nova:ports>
Nov 13 23:50:10 user nova-compute[75307]:     </nova:instance>
Nov 13 23:50:10 user nova-compute[75307]:   </metadata>
Nov 13 23:50:10 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:50:10 user nova-compute[75307]:     <system>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="serial">c54af9a8-e11d-4d67-a25d-ba916c43f2a3</entry>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="uuid">c54af9a8-e11d-4d67-a25d-ba916c43f2a3</entry>
Nov 13 23:50:10 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:50:10 user nova-compute[75307]:     </system>
Nov 13 23:50:10 user nova-compute[75307]:   </sysinfo>
Nov 13 23:50:10 user nova-compute[75307]:   <os>
Nov 13 23:50:10 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:50:10 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:50:10 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:50:10 user nova-compute[75307]:   </os>
Nov 13 23:50:10 user nova-compute[75307]:   <features>
Nov 13 23:50:10 user nova-compute[75307]:     <acpi/>
Nov 13 23:50:10 user nova-compute[75307]:     <apic/>
Nov 13 23:50:10 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:50:10 user nova-compute[75307]:   </features>
Nov 13 23:50:10 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:50:10 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:50:10 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:50:10 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:50:10 user nova-compute[75307]:   </clock>
Nov 13 23:50:10 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:50:10 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:50:10 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:50:10 user nova-compute[75307]:   </cpu>
Nov 13 23:50:10 user nova-compute[75307]:   <devices>
Nov 13 23:50:10 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:50:10 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:50:10 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk"/>
Nov 13 23:50:10 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:50:10 user nova-compute[75307]:     </disk>
Nov 13 23:50:10 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:50:10 user nova-compute[75307]:       <mac address="fa:16:3e:00:9e:63"/>
Nov 13 23:50:10 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:50:10 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:50:10 user nova-compute[75307]:       <target dev="tapb14184ae-68"/>
Nov 13 23:50:10 user nova-compute[75307]:     </interface>
Nov 13 23:50:10 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:50:10 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/console.log" append="off"/>
Nov 13 23:50:10 user nova-compute[75307]:     </serial>
Nov 13 23:50:10 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:50:10 user nova-compute[75307]:     <video>
Nov 13 23:50:10 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:50:10 user nova-compute[75307]:     </video>
Nov 13 23:50:10 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:50:10 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:50:10 user nova-compute[75307]:     </rng>
Nov 13 23:50:10 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:50:10 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:50:10 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:50:10 user nova-compute[75307]:     </memballoon>
Nov 13 23:50:10 user nova-compute[75307]:   </devices>
Nov 13 23:50:10 user nova-compute[75307]: </domain>
Nov 13 23:50:10 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='1d367df4-54d6-4058-804d-730e017483ac',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-537426490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:46:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member',shelved_at='2023-11-13T23:48:15.420752',shelved_host='user',shelved_image_id='1d367df4-54d6-4058-804d-730e017483ac'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG os_vif [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23744a36-6ef0-5ccb-a8a6-1f3576c9b51a', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb14184ae-68, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb14184ae-68, col_values=(('qos', UUID('e55a53b5-770f-46ae-8e5c-947b47af7a7e')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb14184ae-68, col_values=(('external_ids', {'iface-id': 'b14184ae-685c-4a0f-9f46-5e2cb47fcf9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:9e:63', 'vm-uuid': 'c54af9a8-e11d-4d67-a25d-ba916c43f2a3'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:10 user nova-compute[75307]: INFO os_vif [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68')
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:50:10 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] No VIF found with MAC fa:16:3e:00:9e:63, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:50:12 user nova-compute[75307]: WARNING nova.compute.manager [req-9268dbd7-0ba0-4972-8f0b-40db47f26db0 req-b6e441ff-6d4b-46cf-a92b-169f2ef6e7be service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:50:14 user nova-compute[75307]: WARNING nova.compute.manager [req-3e2c791c-2c53-42f2-a875-e9796e4e5267 req-dfd31568-a860-4d29-9318-39bfa4c046a8 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state shelved_offloaded and task_state spawning.
Nov 13 23:50:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:50:14 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance spawned successfully.
Nov 13 23:50:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:50:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f7f4231c-781e-46d6-94a9-ca52e3dd3c42 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.720s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:24 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:50:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:30 user nova-compute[75307]: INFO nova.compute.manager [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Terminating instance
Nov 13 23:50:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:50:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-unplugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] No waiting events found dispatching network-vif-unplugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-050d23ef-1054-482e-b6f8-ac3054db0bf7 req-4d573137-e3cc-4672-b8af-bfa18dc81599 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-unplugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Instance destroyed successfully.
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lazy-loading 'resources' on Instance uuid f619c353-0802-4546-a6e3-4a9b1e89f084 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:30:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697303006',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697303006',id=36,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:31:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='324dfec822e6496d9601b2198091aa31',ramdisk_id='',reservation_id='r-8qmv1pt6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-29041052',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:32:52Z,user_data=None,user_id='049e1cfffeef4a1996a661e5a3894ac1',uuid=f619c353-0802-4546-a6e3-4a9b1e89f084,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converting VIF {"id": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "address": "fa:16:3e:e8:38:6d", "network": {"id": "561cdc2d-2259-4b96-b26c-57a1346b0b96", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-84078872-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "324dfec822e6496d9601b2198091aa31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe50f192-d2", "ovs_interfaceid": "fe50f192-d26e-4b53-b5e8-b428aed38da4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG os_vif [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe50f192-d2, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ab599a79-4eb5-47ca-87f8-53f5c143cdd1) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:31 user nova-compute[75307]: INFO os_vif [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:38:6d,bridge_name='br-int',has_traffic_filtering=True,id=fe50f192-d26e-4b53-b5e8-b428aed38da4,network=Network(561cdc2d-2259-4b96-b26c-57a1346b0b96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe50f192-d2')
Nov 13 23:50:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Deleting instance files /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084_del
Nov 13 23:50:31 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Deletion of /opt/stack/data/nova/instances/f619c353-0802-4546-a6e3-4a9b1e89f084_del complete
Nov 13 23:50:31 user nova-compute[75307]: INFO nova.compute.manager [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 23:50:31 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:50:31 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:50:32 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Took 0.43 seconds to deallocate network for instance.
Nov 13 23:50:32 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8455e4c-9213-4d45-a55d-0dd95494d547 req-0b0f0483-a7ef-4c1b-8c8d-af0d0b5147e2 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-deleted-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:32 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Deleted allocations for instance f619c353-0802-4546-a6e3-4a9b1e89f084
Nov 13 23:50:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1f8a90ed-a978-433a-857a-c04e17fb6281 tempest-ServerBootFromVolumeStableRescueTest-29041052 tempest-ServerBootFromVolumeStableRescueTest-29041052-project-member] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.636s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] Acquiring lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] Lock "f619c353-0802-4546-a6e3-4a9b1e89f084-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] No waiting events found dispatching network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:50:33 user nova-compute[75307]: WARNING nova.compute.manager [req-f654f3b0-f214-405a-ab11-492ccb6550ba req-7aad7005-8d28-43dc-a4f1-66c2a3015906 service nova] [instance: f619c353-0802-4546-a6e3-4a9b1e89f084] Received unexpected event network-vif-plugged-fe50f192-d26e-4b53-b5e8-b428aed38da4 for instance with vm_state deleted and task_state None.
Nov 13 23:50:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:37 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:38 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:50:38 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8910MB free_disk=25.14508056640625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:50:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:50:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:48 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:50 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:50:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:50:50 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:50:50 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:50:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:50:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:50:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:51:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:51:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:23 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:51:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:51:29 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [{"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:51:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-c54af9a8-e11d-4d67-a25d-ba916c43f2a3" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:51:29 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:51:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:51:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:51:38 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:51:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:51:39 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8934MB free_disk=25.143169403076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:51:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.198s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:51:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:54 user nova-compute[75307]: INFO nova.compute.manager [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Terminating instance
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.compute.manager [req-68787d69-b895-4ee8-9668-59227979748d req-eeac7a38-620b-4541-bb19-635019be6a61 service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Instance destroyed successfully.
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.objects.instance [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lazy-loading 'resources' on Instance uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-13T23:46:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-930756203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-930756203',id=48,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNOlGTTIcCjipt2cxK6TlY4eJbO0xUXE9tx5NIsTvCVle7eev8k+K59/BC8LXDKMevh0AfhIBTA01NX4OpEOLGIYLQwWW6COHyMy0mAvVkTgP2NqWGy4ekBCs4Xl/M4zYQ==',key_name='tempest-keypair-537426490',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:50:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b267b7151e414c9180bc7c8e5accd6de',ramdisk_id='',reservation_id='r-qzezqrlz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-620800295',owner_user_name='tempest-AttachVolumeShelveTestJSON-620800295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:50:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2709ea16f7b6424a9c67107096249c3e',uuid=c54af9a8-e11d-4d67-a25d-ba916c43f2a3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converting VIF {"id": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "address": "fa:16:3e:00:9e:63", "network": {"id": "fbedc551-fa44-4163-a80f-aefb7edf15ee", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-105144026-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.215", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b267b7151e414c9180bc7c8e5accd6de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb14184ae-68", "ovs_interfaceid": "b14184ae-685c-4a0f-9f46-5e2cb47fcf9a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG os_vif [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb14184ae-68, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e55a53b5-770f-46ae-8e5c-947b47af7a7e) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:54 user nova-compute[75307]: INFO os_vif [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:00:9e:63,bridge_name='br-int',has_traffic_filtering=True,id=b14184ae-685c-4a0f-9f46-5e2cb47fcf9a,network=Network(fbedc551-fa44-4163-a80f-aefb7edf15ee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb14184ae-68')
Nov 13 23:51:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Deleting instance files /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3_del
Nov 13 23:51:55 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Deletion of /opt/stack/data/nova/instances/c54af9a8-e11d-4d67-a25d-ba916c43f2a3_del complete
Nov 13 23:51:55 user nova-compute[75307]: INFO nova.compute.manager [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 13 23:51:55 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:51:55 user nova-compute[75307]: WARNING nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] While synchronizing instance power states, found 1 instances in the database and 0 instances on the hypervisor.
Nov 13 23:51:55 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid c54af9a8-e11d-4d67-a25d-ba916c43f2a3 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:55 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:51:55 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Took 0.90 seconds to deallocate network for instance.
Nov 13 23:51:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-e75063f6-b28f-4bc2-babb-e81955bb9183 req-6c91979f-5a07-4873-917a-11b754f6ca1a service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-deleted-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.113s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:56 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Deleted allocations for instance c54af9a8-e11d-4d67-a25d-ba916c43f2a3
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-343b0aea-72f1-49ad-9acf-47ec25657647 tempest-AttachVolumeShelveTestJSON-620800295 tempest-AttachVolumeShelveTestJSON-620800295-project-member] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.112s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.627s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:56 user nova-compute[75307]: INFO nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 13 23:51:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:57 user nova-compute[75307]: WARNING nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state deleted and task_state None.
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:57 user nova-compute[75307]: WARNING nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state deleted and task_state None.
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:57 user nova-compute[75307]: WARNING nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state deleted and task_state None.
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:57 user nova-compute[75307]: WARNING nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-unplugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state deleted and task_state None.
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Acquiring lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] Lock "c54af9a8-e11d-4d67-a25d-ba916c43f2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:51:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] No waiting events found dispatching network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:51:57 user nova-compute[75307]: WARNING nova.compute.manager [req-49ec392f-861d-48b5-967b-b095a930a542 req-560b8b0a-18d8-4c53-a19b-78cd1791182e service nova] [instance: c54af9a8-e11d-4d67-a25d-ba916c43f2a3] Received unexpected event network-vif-plugged-b14184ae-685c-4a0f-9f46-5e2cb47fcf9a for instance with vm_state deleted and task_state None.
Nov 13 23:51:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:51:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:52:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:52:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:52:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:52:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:52:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:52:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:52:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9107MB free_disk=25.162410736083984GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:52:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:52:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:52:53 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:52:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:53:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:53:12 user nova-compute[75307]: INFO nova.compute.claims [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Claim successful on node user
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:53:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.policy [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4b95352dc254923b5495b599f2834a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65e305fd4942a090f29861b023ff04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:53:12 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Creating image(s)
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "/opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "/opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "/opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk 1073741824" returned: 0 in 0.055s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Successfully created port: e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Cannot resize image /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Ensure instance console log exists: /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Successfully updated port: e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquired lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-changed-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.compute.manager [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Refreshing instance network info cache due to event network-changed-e1e65782-9430-48a1-b60e-be689c40a5d4. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] Acquiring lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:53:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Releasing lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Instance network_info: |[{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] Acquired lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Refreshing network info cache for port e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Start _get_guest_xml network_info=[{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:53:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:53:14 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762484112',display_name='tempest-VolumesActionsTest-instance-762484112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762484112',id=49,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-o41b1o29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:53:13Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=5ea12e8c-91d9-4a4e-b9e2-462307e6458a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.objects.instance [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lazy-loading 'pci_devices' on Instance uuid 5ea12e8c-91d9-4a4e-b9e2-462307e6458a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:53:14 user nova-compute[75307]:   <uuid>5ea12e8c-91d9-4a4e-b9e2-462307e6458a</uuid>
Nov 13 23:53:14 user nova-compute[75307]:   <name>instance-00000031</name>
Nov 13 23:53:14 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:53:14 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:53:14 user nova-compute[75307]:   <metadata>
Nov 13 23:53:14 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:53:14 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:name>tempest-VolumesActionsTest-instance-762484112</nova:name>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:53:14</nova:creationTime>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:53:14 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:53:14 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:owner>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:user uuid="a4b95352dc254923b5495b599f2834a3">tempest-VolumesActionsTest-77898554-project-member</nova:user>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:project uuid="7c65e305fd4942a090f29861b023ff04">tempest-VolumesActionsTest-77898554</nova:project>
Nov 13 23:53:14 user nova-compute[75307]:       </nova:owner>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:53:14 user nova-compute[75307]:       <nova:ports>
Nov 13 23:53:14 user nova-compute[75307]:         <nova:port uuid="e1e65782-9430-48a1-b60e-be689c40a5d4">
Nov 13 23:53:14 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 13 23:53:14 user nova-compute[75307]:         </nova:port>
Nov 13 23:53:14 user nova-compute[75307]:       </nova:ports>
Nov 13 23:53:14 user nova-compute[75307]:     </nova:instance>
Nov 13 23:53:14 user nova-compute[75307]:   </metadata>
Nov 13 23:53:14 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:53:14 user nova-compute[75307]:     <system>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="serial">5ea12e8c-91d9-4a4e-b9e2-462307e6458a</entry>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="uuid">5ea12e8c-91d9-4a4e-b9e2-462307e6458a</entry>
Nov 13 23:53:14 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:53:14 user nova-compute[75307]:     </system>
Nov 13 23:53:14 user nova-compute[75307]:   </sysinfo>
Nov 13 23:53:14 user nova-compute[75307]:   <os>
Nov 13 23:53:14 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:53:14 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:53:14 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:53:14 user nova-compute[75307]:   </os>
Nov 13 23:53:14 user nova-compute[75307]:   <features>
Nov 13 23:53:14 user nova-compute[75307]:     <acpi/>
Nov 13 23:53:14 user nova-compute[75307]:     <apic/>
Nov 13 23:53:14 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:53:14 user nova-compute[75307]:   </features>
Nov 13 23:53:14 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:53:14 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:53:14 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:53:14 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:53:14 user nova-compute[75307]:   </clock>
Nov 13 23:53:14 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:53:14 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:53:14 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:53:14 user nova-compute[75307]:   </cpu>
Nov 13 23:53:14 user nova-compute[75307]:   <devices>
Nov 13 23:53:14 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:53:14 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:53:14 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk"/>
Nov 13 23:53:14 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:53:14 user nova-compute[75307]:     </disk>
Nov 13 23:53:14 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:53:14 user nova-compute[75307]:       <mac address="fa:16:3e:d3:ba:83"/>
Nov 13 23:53:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:53:14 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:53:14 user nova-compute[75307]:       <target dev="tape1e65782-94"/>
Nov 13 23:53:14 user nova-compute[75307]:     </interface>
Nov 13 23:53:14 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:53:14 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/console.log" append="off"/>
Nov 13 23:53:14 user nova-compute[75307]:     </serial>
Nov 13 23:53:14 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:53:14 user nova-compute[75307]:     <video>
Nov 13 23:53:14 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:53:14 user nova-compute[75307]:     </video>
Nov 13 23:53:14 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:53:14 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:53:14 user nova-compute[75307]:     </rng>
Nov 13 23:53:14 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:53:14 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:53:14 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:53:14 user nova-compute[75307]:     </memballoon>
Nov 13 23:53:14 user nova-compute[75307]:   </devices>
Nov 13 23:53:14 user nova-compute[75307]: </domain>
Nov 13 23:53:14 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762484112',display_name='tempest-VolumesActionsTest-instance-762484112',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762484112',id=49,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-o41b1o29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:53:13Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=5ea12e8c-91d9-4a4e-b9e2-462307e6458a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG os_vif [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3d127a3-b334-5a22-b573-d89b818535b3', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape1e65782-94, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape1e65782-94, col_values=(('qos', UUID('1d2f2711-ba29-4a22-9103-f88265f1e7f9')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape1e65782-94, col_values=(('external_ids', {'iface-id': 'e1e65782-9430-48a1-b60e-be689c40a5d4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:ba:83', 'vm-uuid': '5ea12e8c-91d9-4a4e-b9e2-462307e6458a'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:14 user nova-compute[75307]: INFO os_vif [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94')
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] No VIF found with MAC fa:16:3e:d3:ba:83, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updated VIF entry in instance network info cache for port e1e65782-9430-48a1-b60e-be689c40a5d4. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:53:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-294f1c9a-77a7-4a8b-a49c-68b6e2a17e4f req-af60cb64-6658-4b4d-aade-8a260ce89cbd service nova] Releasing lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:15 user nova-compute[75307]: DEBUG nova.compute.manager [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:53:15 user nova-compute[75307]: WARNING nova.compute.manager [req-269ce21b-a8ec-406b-9eda-d1cc86f69e65 req-d905e161-a947-43f2-b867-7f5956d62031 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state building and task_state spawning.
Nov 13 23:53:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:53:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Instance spawned successfully.
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:53:17 user nova-compute[75307]: WARNING nova.compute.manager [req-65fb19ad-530d-4922-a79c-9e5412e00c82 req-9fb4887c-8559-42c4-92f4-2b25cb174db7 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state building and task_state spawning.
Nov 13 23:53:17 user nova-compute[75307]: INFO nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Took 5.11 seconds to spawn the instance on the hypervisor.
Nov 13 23:53:17 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:53:18 user nova-compute[75307]: INFO nova.compute.manager [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Took 5.60 seconds to build instance.
Nov 13 23:53:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35290f10-a10a-46a9-904e-610a7af5982e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.704s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:53:30 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 5ea12e8c-91d9-4a4e-b9e2-462307e6458a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:53:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:53:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:53:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:53:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:53:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:53:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:53:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=25.13162612915039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5ea12e8c-91d9-4a4e-b9e2-462307e6458a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:53:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:53:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:53:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:53:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:54:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:54:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:54:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:54:30 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 5ea12e8c-91d9-4a4e-b9e2-462307e6458a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:54:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [{"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:54:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-5ea12e8c-91d9-4a4e-b9e2-462307e6458a" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:54:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:54:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:54:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:54:39 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:54:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:54:40 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=25.13086700439453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 5ea12e8c-91d9-4a4e-b9e2-462307e6458a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:54:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:54:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:54:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:54:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:54:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:03 user nova-compute[75307]: INFO nova.compute.manager [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Terminating instance
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.compute.manager [req-4ea5d3fa-8b1d-44aa-81dc-65ce16a5bd6c req-839b18eb-5095-4c05-aab7-b27bf69f89a4 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Instance destroyed successfully.
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lazy-loading 'resources' on Instance uuid 5ea12e8c-91d9-4a4e-b9e2-462307e6458a {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:53:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-762484112',display_name='tempest-VolumesActionsTest-instance-762484112',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-762484112',id=49,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:53:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-o41b1o29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:53:18Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=5ea12e8c-91d9-4a4e-b9e2-462307e6458a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "e1e65782-9430-48a1-b60e-be689c40a5d4", "address": "fa:16:3e:d3:ba:83", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape1e65782-94", "ovs_interfaceid": "e1e65782-9430-48a1-b60e-be689c40a5d4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG os_vif [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape1e65782-94, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d2f2711-ba29-4a22-9103-f88265f1e7f9) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:03 user nova-compute[75307]: INFO os_vif [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:ba:83,bridge_name='br-int',has_traffic_filtering=True,id=e1e65782-9430-48a1-b60e-be689c40a5d4,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape1e65782-94')
Nov 13 23:55:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Deleting instance files /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a_del
Nov 13 23:55:03 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Deletion of /opt/stack/data/nova/instances/5ea12e8c-91d9-4a4e-b9e2-462307e6458a_del complete
Nov 13 23:55:03 user nova-compute[75307]: INFO nova.compute.manager [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 13 23:55:03 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:55:03 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:55:04 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Took 0.84 seconds to deallocate network for instance.
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-9bbea2b5-2794-4b49-a18a-b6078dd7322c req-c65cec36-4a58-409d-8623-90c0b0230800 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-deleted-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:04 user nova-compute[75307]: INFO nova.compute.manager [req-9bbea2b5-2794-4b49-a18a-b6078dd7322c req-c65cec36-4a58-409d-8623-90c0b0230800 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Neutron deleted interface e1e65782-9430-48a1-b60e-be689c40a5d4; detaching it from the instance and deleting it from the info cache
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.network.neutron [req-9bbea2b5-2794-4b49-a18a-b6078dd7322c req-c65cec36-4a58-409d-8623-90c0b0230800 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.compute.manager [req-9bbea2b5-2794-4b49-a18a-b6078dd7322c req-c65cec36-4a58-409d-8623-90c0b0230800 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Detach interface failed, port_id=e1e65782-9430-48a1-b60e-be689c40a5d4, reason: Instance 5ea12e8c-91d9-4a4e-b9e2-462307e6458a could not be found. {{(pid=75307) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:55:04 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Deleted allocations for instance 5ea12e8c-91d9-4a4e-b9e2-462307e6458a
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-35109303-eb2e-439c-8d3f-7d3a8c56e4d5 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.053s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:05 user nova-compute[75307]: WARNING nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state deleted and task_state None.
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:05 user nova-compute[75307]: WARNING nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state deleted and task_state None.
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:05 user nova-compute[75307]: WARNING nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state deleted and task_state None.
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:05 user nova-compute[75307]: WARNING nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-unplugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state deleted and task_state None.
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Acquiring lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] Lock "5ea12e8c-91d9-4a4e-b9e2-462307e6458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:05 user nova-compute[75307]: DEBUG nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] No waiting events found dispatching network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:05 user nova-compute[75307]: WARNING nova.compute.manager [req-3cb0bc9a-7a02-41e8-935e-37fa3ee21391 req-ab5670c1-2dc4-495f-be63-9a7a38402739 service nova] [instance: 5ea12e8c-91d9-4a4e-b9e2-462307e6458a] Received unexpected event network-vif-plugged-e1e65782-9430-48a1-b60e-be689c40a5d4 for instance with vm_state deleted and task_state None.
Nov 13 23:55:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:27 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:55:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:55:30 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:55:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:55:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:40 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:55:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:55:41 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9102MB free_disk=25.157974243164062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:55:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:51 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:55:51 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 13 23:55:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:55:54 user nova-compute[75307]: INFO nova.compute.claims [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Claim successful on node user
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.194s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:55:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.policy [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a4b95352dc254923b5495b599f2834a3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c65e305fd4942a090f29861b023ff04', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:55:54 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Creating image(s)
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "/opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "/opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "/opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:54 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc,backing_fmt=raw /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk 1073741824" returned: 0 in 0.044s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "5c24cbfcd83c19632f122847bd5d6fc51f4776dc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Successfully created port: 096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5c24cbfcd83c19632f122847bd5d6fc51f4776dc --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Cannot resize image /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Ensure instance console log exists: /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:55 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Successfully updated port: 096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquired lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-changed-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.compute.manager [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Refreshing instance network info cache due to event network-changed-096461d9-cb32-4de6-ae8a-ce82132233f3. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] Acquiring lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updating instance_info_cache with network_info: [{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Releasing lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Instance network_info: |[{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] Acquired lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Refreshing network info cache for port 096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Start _get_guest_xml network_info=[{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': 'dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:55:56 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:55:56 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:10:22Z,direct_url=<?>,disk_format='qcow2',id=dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='8deffd35005d4dd285fe42077488177a',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:10:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897886657',display_name='tempest-VolumesActionsTest-instance-897886657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897886657',id=50,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-5ktjc2fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:55:55Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=dbb57d08-0704-4d0a-a36b-7f31e955d5c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.objects.instance [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lazy-loading 'pci_devices' on Instance uuid dbb57d08-0704-4d0a-a36b-7f31e955d5c8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:55:56 user nova-compute[75307]:   <uuid>dbb57d08-0704-4d0a-a36b-7f31e955d5c8</uuid>
Nov 13 23:55:56 user nova-compute[75307]:   <name>instance-00000032</name>
Nov 13 23:55:56 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:55:56 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:55:56 user nova-compute[75307]:   <metadata>
Nov 13 23:55:56 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:55:56 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:name>tempest-VolumesActionsTest-instance-897886657</nova:name>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:55:56</nova:creationTime>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:55:56 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:55:56 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:owner>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:user uuid="a4b95352dc254923b5495b599f2834a3">tempest-VolumesActionsTest-77898554-project-member</nova:user>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:project uuid="7c65e305fd4942a090f29861b023ff04">tempest-VolumesActionsTest-77898554</nova:project>
Nov 13 23:55:56 user nova-compute[75307]:       </nova:owner>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:root type="image" uuid="dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7"/>
Nov 13 23:55:56 user nova-compute[75307]:       <nova:ports>
Nov 13 23:55:56 user nova-compute[75307]:         <nova:port uuid="096461d9-cb32-4de6-ae8a-ce82132233f3">
Nov 13 23:55:56 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 13 23:55:56 user nova-compute[75307]:         </nova:port>
Nov 13 23:55:56 user nova-compute[75307]:       </nova:ports>
Nov 13 23:55:56 user nova-compute[75307]:     </nova:instance>
Nov 13 23:55:56 user nova-compute[75307]:   </metadata>
Nov 13 23:55:56 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:55:56 user nova-compute[75307]:     <system>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="serial">dbb57d08-0704-4d0a-a36b-7f31e955d5c8</entry>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="uuid">dbb57d08-0704-4d0a-a36b-7f31e955d5c8</entry>
Nov 13 23:55:56 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:55:56 user nova-compute[75307]:     </system>
Nov 13 23:55:56 user nova-compute[75307]:   </sysinfo>
Nov 13 23:55:56 user nova-compute[75307]:   <os>
Nov 13 23:55:56 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:55:56 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:55:56 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:55:56 user nova-compute[75307]:   </os>
Nov 13 23:55:56 user nova-compute[75307]:   <features>
Nov 13 23:55:56 user nova-compute[75307]:     <acpi/>
Nov 13 23:55:56 user nova-compute[75307]:     <apic/>
Nov 13 23:55:56 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:55:56 user nova-compute[75307]:   </features>
Nov 13 23:55:56 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:55:56 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:55:56 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:55:56 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:55:56 user nova-compute[75307]:   </clock>
Nov 13 23:55:56 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:55:56 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:55:56 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:55:56 user nova-compute[75307]:   </cpu>
Nov 13 23:55:56 user nova-compute[75307]:   <devices>
Nov 13 23:55:56 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:55:56 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:55:56 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk"/>
Nov 13 23:55:56 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:55:56 user nova-compute[75307]:     </disk>
Nov 13 23:55:56 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:55:56 user nova-compute[75307]:       <mac address="fa:16:3e:b3:52:2b"/>
Nov 13 23:55:56 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:55:56 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:55:56 user nova-compute[75307]:       <target dev="tap096461d9-cb"/>
Nov 13 23:55:56 user nova-compute[75307]:     </interface>
Nov 13 23:55:56 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:55:56 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/console.log" append="off"/>
Nov 13 23:55:56 user nova-compute[75307]:     </serial>
Nov 13 23:55:56 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:55:56 user nova-compute[75307]:     <video>
Nov 13 23:55:56 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:55:56 user nova-compute[75307]:     </video>
Nov 13 23:55:56 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:55:56 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:55:56 user nova-compute[75307]:     </rng>
Nov 13 23:55:56 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:55:56 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:55:56 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:55:56 user nova-compute[75307]:     </memballoon>
Nov 13 23:55:56 user nova-compute[75307]:   </devices>
Nov 13 23:55:56 user nova-compute[75307]: </domain>
Nov 13 23:55:56 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897886657',display_name='tempest-VolumesActionsTest-instance-897886657',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897886657',id=50,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-5ktjc2fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:55:55Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=dbb57d08-0704-4d0a-a36b-7f31e955d5c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG os_vif [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b1a6c93e-02e6-597b-9d4f-73594bbe2d6f', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap096461d9-cb, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap096461d9-cb, col_values=(('qos', UUID('f523b23a-6dae-4bd7-b19f-6e9d384d8cff')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap096461d9-cb, col_values=(('external_ids', {'iface-id': '096461d9-cb32-4de6-ae8a-ce82132233f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:52:2b', 'vm-uuid': 'dbb57d08-0704-4d0a-a36b-7f31e955d5c8'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:56 user nova-compute[75307]: INFO os_vif [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb')
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] No VIF found with MAC fa:16:3e:b3:52:2b, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updated VIF entry in instance network info cache for port 096461d9-cb32-4de6-ae8a-ce82132233f3. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG nova.network.neutron [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updating instance_info_cache with network_info: [{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:55:56 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3e6eb9fa-0f86-4ca9-8c64-21cdfbf7279a req-730e72fa-20f9-44e0-b9ac-b8737571933d service nova] Releasing lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:57 user nova-compute[75307]: DEBUG nova.compute.manager [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] No waiting events found dispatching network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:57 user nova-compute[75307]: WARNING nova.compute.manager [req-3434a271-c8e5-4f50-a2eb-b19cd3b9d80e req-a3de3b1e-4988-4518-bb50-d2f6fc150000 service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received unexpected event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 for instance with vm_state building and task_state spawning.
Nov 13 23:55:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:55:59 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Instance spawned successfully.
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.compute.manager [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] No waiting events found dispatching network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:55:59 user nova-compute[75307]: WARNING nova.compute.manager [req-5e34535c-2d93-4876-a21f-8343ee75d6b7 req-73843d2a-790e-42c5-83bc-a621eaeb4cdb service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received unexpected event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 for instance with vm_state building and task_state spawning.
Nov 13 23:55:59 user nova-compute[75307]: INFO nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 13 23:55:59 user nova-compute[75307]: DEBUG nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:56:00 user nova-compute[75307]: INFO nova.compute.manager [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Took 5.52 seconds to build instance.
Nov 13 23:56:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-2932a304-b30b-47da-961d-c148649e0a99 tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.618s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:56:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 13 23:56:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 13 23:56:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:28 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:56:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid dbb57d08-0704-4d0a-a36b-7f31e955d5c8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:56:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updating instance_info_cache with network_info: [{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:56:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:56:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:56:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:56:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:56:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:56:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:56:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9014MB free_disk=25.128559112548828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance dbb57d08-0704-4d0a-a36b-7f31e955d5c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:56:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:56:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:56:47 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:56:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:56:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:57:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:01 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:57:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:29 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:57:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid dbb57d08-0704-4d0a-a36b-7f31e955d5c8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:57:33 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updating instance_info_cache with network_info: [{"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:57:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-dbb57d08-0704-4d0a-a36b-7f31e955d5c8" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:57:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:57:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:34 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:57:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:57:41 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:57:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:57:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=25.120155334472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance dbb57d08-0704-4d0a-a36b-7f31e955d5c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:57:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:45 user nova-compute[75307]: INFO nova.compute.manager [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Terminating instance
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.compute.manager [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-unplugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] No waiting events found dispatching network-vif-unplugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.compute.manager [req-00c594c5-099a-463e-bda6-09f8707f7851 req-f767deff-d9d2-4c0c-9c75-a7b928954a3a service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-unplugged-096461d9-cb32-4de6-ae8a-ce82132233f3 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:45 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Instance destroyed successfully.
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lazy-loading 'resources' on Instance uuid dbb57d08-0704-4d0a-a36b-7f31e955d5c8 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:55:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-897886657',display_name='tempest-VolumesActionsTest-instance-897886657',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-897886657',id=50,image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:55:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7c65e305fd4942a090f29861b023ff04',ramdisk_id='',reservation_id='r-5ktjc2fd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dd04a3db-a71a-48e5-9d4a-7a1ee8a1dbd7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-77898554',owner_user_name='tempest-VolumesActionsTest-77898554-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-13T23:56:00Z,user_data=None,user_id='a4b95352dc254923b5495b599f2834a3',uuid=dbb57d08-0704-4d0a-a36b-7f31e955d5c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converting VIF {"id": "096461d9-cb32-4de6-ae8a-ce82132233f3", "address": "fa:16:3e:b3:52:2b", "network": {"id": "cd3dea51-7a39-48c7-8712-441c47b58bee", "bridge": "br-int", "label": "tempest-VolumesActionsTest-2073472154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7c65e305fd4942a090f29861b023ff04", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap096461d9-cb", "ovs_interfaceid": "096461d9-cb32-4de6-ae8a-ce82132233f3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:57:45 user nova-compute[75307]: DEBUG os_vif [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap096461d9-cb, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f523b23a-6dae-4bd7-b19f-6e9d384d8cff) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:46 user nova-compute[75307]: INFO os_vif [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b3:52:2b,bridge_name='br-int',has_traffic_filtering=True,id=096461d9-cb32-4de6-ae8a-ce82132233f3,network=Network(cd3dea51-7a39-48c7-8712-441c47b58bee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap096461d9-cb')
Nov 13 23:57:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Deleting instance files /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8_del
Nov 13 23:57:46 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Deletion of /opt/stack/data/nova/instances/dbb57d08-0704-4d0a-a36b-7f31e955d5c8_del complete
Nov 13 23:57:46 user nova-compute[75307]: INFO nova.compute.manager [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 13 23:57:46 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:57:46 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Took 0.45 seconds to deallocate network for instance.
Nov 13 23:57:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.compute.manager [req-275ee44a-18dd-47d8-9642-6aabc3b2ed5d req-202cb87d-b623-46ba-97e0-a690a8256a40 service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-deleted-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:57:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:46 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Deleted allocations for instance dbb57d08-0704-4d0a-a36b-7f31e955d5c8
Nov 13 23:57:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-61c78388-9280-4e6c-b852-4cd052cd4b0e tempest-VolumesActionsTest-77898554 tempest-VolumesActionsTest-77898554-project-member] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:57:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] Acquiring lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:57:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:57:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] Lock "dbb57d08-0704-4d0a-a36b-7f31e955d5c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:57:47 user nova-compute[75307]: DEBUG nova.compute.manager [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] No waiting events found dispatching network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:57:47 user nova-compute[75307]: WARNING nova.compute.manager [req-d1ab4798-56f2-4a85-a79c-a2274fd7f791 req-0f12b1d8-ac8d-4409-8526-b12814885b6b service nova] [instance: dbb57d08-0704-4d0a-a36b-7f31e955d5c8] Received unexpected event network-vif-plugged-096461d9-cb32-4de6-ae8a-ce82132233f3 for instance with vm_state deleted and task_state None.
Nov 13 23:57:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:57:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:57:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:58:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:30 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:58:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:58:33 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 13 23:58:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:58:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:58:41 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:58:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:58:42 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9125MB free_disk=25.1470947265625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:58:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:58:46 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:58:51 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:58:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:01 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:04 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 13 23:59:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:59:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:21 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 13 23:59:22 user nova-compute[75307]: INFO nova.compute.claims [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Claim successful on node user
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 13 23:59:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.policy [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06052d28274541aba86950780c2d5616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af376c8d42c4a49b9417ea0056a3ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 13 23:59:22 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Creating image(s)
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "1603bad9790fb653a86092aab950ffc67a477bad" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "1603bad9790fb653a86092aab950ffc67a477bad" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Successfully created port: 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.part --force-share --output=json" returned: 0 in 0.208s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.virt.images [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] 38e23742-0819-4c20-916e-b0cab895fada was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.part /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.part /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.converted" returned: 0 in 0.230s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "1603bad9790fb653a86092aab950ffc67a477bad" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.952s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Successfully updated port: 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-changed-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing instance network info cache due to event network-changed-6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "1603bad9790fb653a86092aab950ffc67a477bad" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "1603bad9790fb653a86092aab950ffc67a477bad" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:23 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad,backing_fmt=raw /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad,backing_fmt=raw /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk 1073741824" returned: 0 in 0.054s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "1603bad9790fb653a86092aab950ffc67a477bad" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.neutron [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance network_info: |[{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing network info cache for port 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Cannot resize image /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Ensure instance console log exists: /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start _get_guest_xml network_info=[{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:59:19Z,direct_url=<?>,disk_format='qcow2',id=38e23742-0819-4c20-916e-b0cab895fada,min_disk=0,min_ram=0,name='tempest-scenario-img--1035861363',owner='0af376c8d42c4a49b9417ea0056a3ab4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:59:21Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '38e23742-0819-4c20-916e-b0cab895fada'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 13 23:59:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:59:24 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-13T23:59:19Z,direct_url=<?>,disk_format='qcow2',id=38e23742-0819-4c20-916e-b0cab895fada,min_disk=0,min_ram=0,name='tempest-scenario-img--1035861363',owner='0af376c8d42c4a49b9417ea0056a3ab4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-13T23:59:21Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:59:23Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.objects.instance [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'pci_devices' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated VIF entry in instance network info cache for port 6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] End _get_guest_xml xml=<domain type="kvm">
Nov 13 23:59:24 user nova-compute[75307]:   <uuid>2711471b-0c0a-4d87-9f58-37c9b160e352</uuid>
Nov 13 23:59:24 user nova-compute[75307]:   <name>instance-00000033</name>
Nov 13 23:59:24 user nova-compute[75307]:   <memory>524288</memory>
Nov 13 23:59:24 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 13 23:59:24 user nova-compute[75307]:   <metadata>
Nov 13 23:59:24 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 13 23:59:24 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:name>tempest-TestMinimumBasicScenario-server-1267095709</nova:name>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:creationTime>2023-11-13 23:59:24</nova:creationTime>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 13 23:59:24 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 13 23:59:24 user nova-compute[75307]:       </nova:flavor>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:owner>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:user uuid="06052d28274541aba86950780c2d5616">tempest-TestMinimumBasicScenario-1936842614-project-member</nova:user>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:project uuid="0af376c8d42c4a49b9417ea0056a3ab4">tempest-TestMinimumBasicScenario-1936842614</nova:project>
Nov 13 23:59:24 user nova-compute[75307]:       </nova:owner>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:root type="image" uuid="38e23742-0819-4c20-916e-b0cab895fada"/>
Nov 13 23:59:24 user nova-compute[75307]:       <nova:ports>
Nov 13 23:59:24 user nova-compute[75307]:         <nova:port uuid="6194118d-a541-4665-a28b-40de7085221a">
Nov 13 23:59:24 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 13 23:59:24 user nova-compute[75307]:         </nova:port>
Nov 13 23:59:24 user nova-compute[75307]:       </nova:ports>
Nov 13 23:59:24 user nova-compute[75307]:     </nova:instance>
Nov 13 23:59:24 user nova-compute[75307]:   </metadata>
Nov 13 23:59:24 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 13 23:59:24 user nova-compute[75307]:     <system>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="serial">2711471b-0c0a-4d87-9f58-37c9b160e352</entry>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="uuid">2711471b-0c0a-4d87-9f58-37c9b160e352</entry>
Nov 13 23:59:24 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 13 23:59:24 user nova-compute[75307]:     </system>
Nov 13 23:59:24 user nova-compute[75307]:   </sysinfo>
Nov 13 23:59:24 user nova-compute[75307]:   <os>
Nov 13 23:59:24 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 13 23:59:24 user nova-compute[75307]:     <boot dev="hd"/>
Nov 13 23:59:24 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 13 23:59:24 user nova-compute[75307]:   </os>
Nov 13 23:59:24 user nova-compute[75307]:   <features>
Nov 13 23:59:24 user nova-compute[75307]:     <acpi/>
Nov 13 23:59:24 user nova-compute[75307]:     <apic/>
Nov 13 23:59:24 user nova-compute[75307]:     <vmcoreinfo/>
Nov 13 23:59:24 user nova-compute[75307]:   </features>
Nov 13 23:59:24 user nova-compute[75307]:   <clock offset="utc">
Nov 13 23:59:24 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 13 23:59:24 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 13 23:59:24 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 13 23:59:24 user nova-compute[75307]:   </clock>
Nov 13 23:59:24 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 13 23:59:24 user nova-compute[75307]:     <model>Nehalem</model>
Nov 13 23:59:24 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 13 23:59:24 user nova-compute[75307]:   </cpu>
Nov 13 23:59:24 user nova-compute[75307]:   <devices>
Nov 13 23:59:24 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 13 23:59:24 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 13 23:59:24 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk"/>
Nov 13 23:59:24 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 13 23:59:24 user nova-compute[75307]:     </disk>
Nov 13 23:59:24 user nova-compute[75307]:     <interface type="ethernet">
Nov 13 23:59:24 user nova-compute[75307]:       <mac address="fa:16:3e:97:84:74"/>
Nov 13 23:59:24 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:59:24 user nova-compute[75307]:       <mtu size="1442"/>
Nov 13 23:59:24 user nova-compute[75307]:       <target dev="tap6194118d-a5"/>
Nov 13 23:59:24 user nova-compute[75307]:     </interface>
Nov 13 23:59:24 user nova-compute[75307]:     <serial type="pty">
Nov 13 23:59:24 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/console.log" append="off"/>
Nov 13 23:59:24 user nova-compute[75307]:     </serial>
Nov 13 23:59:24 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 13 23:59:24 user nova-compute[75307]:     <video>
Nov 13 23:59:24 user nova-compute[75307]:       <model type="virtio"/>
Nov 13 23:59:24 user nova-compute[75307]:     </video>
Nov 13 23:59:24 user nova-compute[75307]:     <rng model="virtio">
Nov 13 23:59:24 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 13 23:59:24 user nova-compute[75307]:     </rng>
Nov 13 23:59:24 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 13 23:59:24 user nova-compute[75307]:     <memballoon model="virtio">
Nov 13 23:59:24 user nova-compute[75307]:       <stats period="10"/>
Nov 13 23:59:24 user nova-compute[75307]:     </memballoon>
Nov 13 23:59:24 user nova-compute[75307]:   </devices>
Nov 13 23:59:24 user nova-compute[75307]: </domain>
Nov 13 23:59:24 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-13T23:59:23Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG os_vif [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a29c0b7-4b0b-51b6-bd16-3227baead959', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-3f7e6d0c-df77-4436-8aea-7a81b9d9ffee req-e36ea791-e133-4920-92a3-1e12711dc193 service nova] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6194118d-a5, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6194118d-a5, col_values=(('qos', UUID('59427630-37fe-43dc-8d42-953b593ecfa0')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6194118d-a5, col_values=(('external_ids', {'iface-id': '6194118d-a541-4665-a28b-40de7085221a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:84:74', 'vm-uuid': '2711471b-0c0a-4d87-9f58-37c9b160e352'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:24 user nova-compute[75307]: INFO os_vif [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5')
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 13 23:59:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No VIF found with MAC fa:16:3e:97:84:74, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 13 23:59:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:59:26 user nova-compute[75307]: WARNING nova.compute.manager [req-1d8c03ef-445b-494e-a7fd-a13720d17c5d req-448186b2-ddfd-462f-a2e5-e14d8aec0d21 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state building and task_state spawning.
Nov 13 23:59:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:26 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 13 23:59:28 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance spawned successfully.
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.compute.manager [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 13 23:59:28 user nova-compute[75307]: WARNING nova.compute.manager [req-7f78427d-39e8-4896-8b41-15fe693c4919 req-25745e5f-4ff7-49c3-9317-42c4dc890c39 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state building and task_state spawning.
Nov 13 23:59:28 user nova-compute[75307]: INFO nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Took 5.41 seconds to spawn the instance on the hypervisor.
Nov 13 23:59:28 user nova-compute[75307]: DEBUG nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 13 23:59:28 user nova-compute[75307]: INFO nova.compute.manager [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Took 5.96 seconds to build instance.
Nov 13 23:59:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-34be7098-5c83-459f-b84e-9970967f2588 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.062s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:31 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 13 23:59:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 13 23:59:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 13 23:59:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 13 23:59:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 13 23:59:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 13 23:59:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:59:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.057231903076172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 2711471b-0c0a-4d87-9f58-37c9b160e352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 13 23:59:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 13 23:59:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:52 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 13 23:59:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 13 23:59:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:32 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:00:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:00:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:00:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:00:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:00:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:00:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:00:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:00:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:00:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:00:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8978MB free_disk=25.054256439208984GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 2711471b-0c0a-4d87-9f58-37c9b160e352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:00:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.472s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:00:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:00:51 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:51 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:00:53 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:00:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:00:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:05 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 00:01:05 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 00:01:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:13 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:15 user nova-compute[75307]: INFO nova.compute.manager [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Attaching volume c0effee8-9eb1-4170-ab43-741dc03464f1 to /dev/vdb
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.utils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc5a84-5535-4bb7-804b-dd554cbac4d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4b8bdf-098d-41cf-86b0-d3f8927eec1f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe6e1a3-542d-4367-b672-0ae91d4770e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c122e050-2a50-46f4-ad40-6c80945fad60]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:01:15 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:01:15 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9486b5f9-3360-4b82-bef7-b372064605ca]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG os_brick.utils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:01:15 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating existing volume attachment record: f02f1bc7-2ad1-42fa-a5d9-4206036c8219 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:01:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:01:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:01:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:01:20 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee73d212-c234-4238-aa29-5e76d9db18dc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:01:20 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7bd92a-e1ca-4971-81e3-a4e68a82e6b9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1] added
Nov 14 00:01:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d1f43d-9160-4aeb-8176-2658ff1a7122]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f856fc-5166-41fa-9c36-d25dde68e57e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHgbZOS {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHgbZOS" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a495851e-80ba-4532-b552-2477e5ea673e]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TIHgbZOS'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6670d2-0d4c-40ec-b83b-f03f029ccbd3]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[40390aa6-42ef-4003-887f-cf5958b7e64e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:01:20 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:01:20 user nova-compute[75307]:  {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:01:20 user nova-compute[75307]: WARNING os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:01:20 user nova-compute[75307]: 
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd5e7c-89d7-4b8b-9369-8c1d55e3dfb4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]
Nov 14 00:01:20 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.
Nov 14 00:01:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[295317ae-be15-48fc-a213-e374fee474cd]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d89ada2-2d5c-4b8f-9e3f-fc0a466f1296]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:20 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[1559c667-3510-409f-9102-3ae2b98a251f]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:20 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26566653566323830', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566653566323830', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:21 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:01:21 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:01:21 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:01:21 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:01:21 user nova-compute[75307]:   <serial>c0effee8-9eb1-4170-ab43-741dc03464f1</serial>
Nov 14 00:01:21 user nova-compute[75307]: </disk>
Nov 14 00:01:21 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:01:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:01:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:01:22 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No VIF found with MAC fa:16:3e:97:84:74, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:01:22 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1c90a685-843f-4501-86e9-9ac9a55d1153 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.456s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-changed-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG nova.compute.manager [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing instance network info cache due to event network-changed-6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing network info cache for port 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated VIF entry in instance network info cache for port 6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:01:26 user nova-compute[75307]: DEBUG nova.network.neutron [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:01:27 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-ea8700d9-b774-4f92-ac48-615d663a4122 req-7732906b-f51d-4d29-b88f-a0ac928ed1b8 service nova] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:01:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-changed-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG nova.compute.manager [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing instance network info cache due to event network-changed-6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing network info cache for port 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated VIF entry in instance network info cache for port 6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG nova.network.neutron [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28ed0263-eddc-41a8-a815-9688b97c3e33 req-2ca6e94c-f7a5-44a7-9b6e-e427d51e8182 service nova] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:01:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:31 user nova-compute[75307]: INFO nova.compute.manager [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Rebooting instance
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG nova.network.neutron [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG nova.compute.manager [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:31 user nova-compute[75307]: DEBUG nova.compute.manager [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:01:31 user nova-compute[75307]: WARNING nova.compute.manager [req-8bce7c55-1b9a-4c94-98c6-5f7f384a630e req-0e805026-53ac-4d7f-8293-2cc00ce04f2b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state active and task_state reboot_started_hard.
Nov 14 00:01:32 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance destroyed successfully.
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'resources' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:01:32Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6194118d-a5, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59427630-37fe-43dc-8d42-953b593ecfa0) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:32 user nova-compute[75307]: INFO os_vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5')
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:01:32 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2b0096-693d-485a-a33b-9e6d2c296d82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:01:32 user nova-compute[75307]: No targets found.
Nov 14 00:01:32 user nova-compute[75307]: iSNS:
Nov 14 00:01:32 user nova-compute[75307]: No targets found.
Nov 14 00:01:32 user nova-compute[75307]: STATIC:
Nov 14 00:01:32 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1
Nov 14 00:01:32 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:01:32 user nova-compute[75307]:                 Iface Name: default
Nov 14 00:01:32 user nova-compute[75307]: FIRMWARE:
Nov 14 00:01:32 user nova-compute[75307]: No targets found.
Nov 14 00:01:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:01:32 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:01:32 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88735a3-ff71-44c0-86f4-78e9c9cb3089]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed7e8e3-8097-4d55-870c-e840d399bb5f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb34220820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd95cdc7-de05-4088-9a41-3246e4454cf8]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a933da-0775-4b8d-889c-909b0a45bb15]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f6300-60c0-48ed-b4d4-80417c6c8bca]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bbe647-cb8e-4423-990d-e939cb110470]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a3d7e3-98fb-4f37-8e7a-d6029dff26af]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db42f29-0bda-4588-91f0-45bfce4cfc62]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]
Nov 14 00:01:32 user nova-compute[75307]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.
Nov 14 00:01:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31ad761-0eb2-4698-92c9-dcb1405744ff]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== disconnect_volume: return (313ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start _get_guest_xml network_info=[{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=38e23742-0819-4c20-916e-b0cab895fada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '38e23742-0819-4c20-916e-b0cab895fada'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2711471b-0c0a-4d87-9f58-37c9b160e352', 'attached_at': '', 'detached_at': '', 'volume_id': 'c0effee8-9eb1-4170-ab43-741dc03464f1', 'serial': 'c0effee8-9eb1-4170-ab43-741dc03464f1'}, 'delete_on_termination': False, 'attachment_id': 'f02f1bc7-2ad1-42fa-a5d9-4206036c8219', 'guest_format': None, 'boot_index': None, 'device_type': 'disk', 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:01:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:01:32 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=38e23742-0819-4c20-916e-b0cab895fada,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.objects.instance [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.objects.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Object Instance<2711471b-0c0a-4d87-9f58-37c9b160e352> lazy-loaded attributes: resources,vcpu_model {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:01:32 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:01:32 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:01:32 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1185a0c-f799-48d2-9713-1d1f93dde16b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:01:32 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d690cd-b59f-4ebd-92c0-67524c4abb94]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1] added
Nov 14 00:01:32 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[940f7976-8eba-484a-8b93-1928c0174459]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[873dc804-26af-4e19-a53d-cb3d0ba5e298]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHgbZOS {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TIHgbZOS" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[508f9107-23c7-4c24-9980-3121e2912942]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TIHgbZOS'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7edde-9f35-467a-8c6f-fcb780644811]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c575fb3-5240-4585-a99b-315eaa1909fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:32 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:01:32 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:01:33 user nova-compute[75307]:  {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:01:33 user nova-compute[75307]: WARNING os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:01:33 user nova-compute[75307]: 
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[f000d9f0-f17d-4f2c-aaef-105c048ee17a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]
Nov 14 00:01:33 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.
Nov 14 00:01:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f88b614-c829-474a-a158-7dbd1d29ed3c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d791a9-97f3-46bb-89b9-04c34e4e5c65]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:01:33 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b7138b-f5b6-4f15-a3cf-fe0a899dc190]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:33 user nova-compute[75307]: DEBUG nova.compute.manager [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:01:33 user nova-compute[75307]: WARNING nova.compute.manager [req-9420a962-fe23-44f7-8bd0-09bf6e5fd65f req-1ba7a592-a8e9-421e-a4b2-ff800b4f3687 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state active and task_state reboot_started_hard.
Nov 14 00:01:34 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26566653566323830', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26566653566323830', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:01:32Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'pci_devices' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Object Instance<2711471b-0c0a-4d87-9f58-37c9b160e352> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:01:34 user nova-compute[75307]:   <uuid>2711471b-0c0a-4d87-9f58-37c9b160e352</uuid>
Nov 14 00:01:34 user nova-compute[75307]:   <name>instance-00000033</name>
Nov 14 00:01:34 user nova-compute[75307]:   <memory>524288</memory>
Nov 14 00:01:34 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 14 00:01:34 user nova-compute[75307]:   <metadata>
Nov 14 00:01:34 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:01:34 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:name>tempest-TestMinimumBasicScenario-server-1267095709</nova:name>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:creationTime>2023-11-14 00:01:32</nova:creationTime>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 14 00:01:34 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:01:34 user nova-compute[75307]:       </nova:flavor>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:owner>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:user uuid="06052d28274541aba86950780c2d5616">tempest-TestMinimumBasicScenario-1936842614-project-member</nova:user>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:project uuid="0af376c8d42c4a49b9417ea0056a3ab4">tempest-TestMinimumBasicScenario-1936842614</nova:project>
Nov 14 00:01:34 user nova-compute[75307]:       </nova:owner>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:root type="image" uuid="38e23742-0819-4c20-916e-b0cab895fada"/>
Nov 14 00:01:34 user nova-compute[75307]:       <nova:ports>
Nov 14 00:01:34 user nova-compute[75307]:         <nova:port uuid="6194118d-a541-4665-a28b-40de7085221a">
Nov 14 00:01:34 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 00:01:34 user nova-compute[75307]:         </nova:port>
Nov 14 00:01:34 user nova-compute[75307]:       </nova:ports>
Nov 14 00:01:34 user nova-compute[75307]:     </nova:instance>
Nov 14 00:01:34 user nova-compute[75307]:   </metadata>
Nov 14 00:01:34 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 14 00:01:34 user nova-compute[75307]:     <system>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="serial">2711471b-0c0a-4d87-9f58-37c9b160e352</entry>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="uuid">2711471b-0c0a-4d87-9f58-37c9b160e352</entry>
Nov 14 00:01:34 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:01:34 user nova-compute[75307]:     </system>
Nov 14 00:01:34 user nova-compute[75307]:   </sysinfo>
Nov 14 00:01:34 user nova-compute[75307]:   <os>
Nov 14 00:01:34 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:01:34 user nova-compute[75307]:     <boot dev="hd"/>
Nov 14 00:01:34 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 14 00:01:34 user nova-compute[75307]:   </os>
Nov 14 00:01:34 user nova-compute[75307]:   <features>
Nov 14 00:01:34 user nova-compute[75307]:     <acpi/>
Nov 14 00:01:34 user nova-compute[75307]:     <apic/>
Nov 14 00:01:34 user nova-compute[75307]:     <vmcoreinfo/>
Nov 14 00:01:34 user nova-compute[75307]:   </features>
Nov 14 00:01:34 user nova-compute[75307]:   <clock offset="utc">
Nov 14 00:01:34 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:01:34 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:01:34 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 14 00:01:34 user nova-compute[75307]:   </clock>
Nov 14 00:01:34 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 14 00:01:34 user nova-compute[75307]:     <model>Nehalem</model>
Nov 14 00:01:34 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:01:34 user nova-compute[75307]:   </cpu>
Nov 14 00:01:34 user nova-compute[75307]:   <devices>
Nov 14 00:01:34 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 14 00:01:34 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:01:34 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk"/>
Nov 14 00:01:34 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 14 00:01:34 user nova-compute[75307]:     </disk>
Nov 14 00:01:34 user nova-compute[75307]:     <disk type="block" device="disk">
Nov 14 00:01:34 user nova-compute[75307]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:01:34 user nova-compute[75307]:       <source dev="/dev/sdb"/>
Nov 14 00:01:34 user nova-compute[75307]:       <target dev="vdb" bus="virtio"/>
Nov 14 00:01:34 user nova-compute[75307]:       <serial>c0effee8-9eb1-4170-ab43-741dc03464f1</serial>
Nov 14 00:01:34 user nova-compute[75307]:     </disk>
Nov 14 00:01:34 user nova-compute[75307]:     <interface type="ethernet">
Nov 14 00:01:34 user nova-compute[75307]:       <mac address="fa:16:3e:97:84:74"/>
Nov 14 00:01:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 14 00:01:34 user nova-compute[75307]:       <mtu size="1442"/>
Nov 14 00:01:34 user nova-compute[75307]:       <target dev="tap6194118d-a5"/>
Nov 14 00:01:34 user nova-compute[75307]:     </interface>
Nov 14 00:01:34 user nova-compute[75307]:     <serial type="pty">
Nov 14 00:01:34 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/console.log" append="off"/>
Nov 14 00:01:34 user nova-compute[75307]:     </serial>
Nov 14 00:01:34 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:01:34 user nova-compute[75307]:     <video>
Nov 14 00:01:34 user nova-compute[75307]:       <model type="virtio"/>
Nov 14 00:01:34 user nova-compute[75307]:     </video>
Nov 14 00:01:34 user nova-compute[75307]:     <rng model="virtio">
Nov 14 00:01:34 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:01:34 user nova-compute[75307]:     </rng>
Nov 14 00:01:34 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:01:34 user nova-compute[75307]:     <memballoon model="virtio">
Nov 14 00:01:34 user nova-compute[75307]:       <stats period="10"/>
Nov 14 00:01:34 user nova-compute[75307]:     </memballoon>
Nov 14 00:01:34 user nova-compute[75307]:   </devices>
Nov 14 00:01:34 user nova-compute[75307]: </domain>
Nov 14 00:01:34 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Object Instance<2711471b-0c0a-4d87-9f58-37c9b160e352> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1603bad9790fb653a86092aab950ffc67a477bad --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Cannot resize image /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.instance [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'migration_context' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.objects.base [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Object Instance<2711471b-0c0a-4d87-9f58-37c9b160e352> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75307) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:01:32Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG os_vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a29c0b7-4b0b-51b6-bd16-3227baead959', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6194118d-a5, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6194118d-a5, col_values=(('qos', UUID('68e7705c-dbbb-4d1b-a627-d45dd870bfe3')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6194118d-a5, col_values=(('external_ids', {'iface-id': '6194118d-a541-4665-a28b-40de7085221a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:84:74', 'vm-uuid': '2711471b-0c0a-4d87-9f58-37c9b160e352'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:01:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:34 user nova-compute[75307]: INFO os_vif [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5')
Nov 14 00:01:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:01:35 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG nova.compute.manager [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:01:36 user nova-compute[75307]: WARNING nova.compute.manager [req-76332e69-42a1-4b6a-9448-3d1b4529c261 req-f018bd3c-d93a-4c05-9c7f-bc71f0fbfa4b service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state active and task_state reboot_started_hard.
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:36 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:01:38 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance rebooted successfully.
Nov 14 00:01:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-42ca711a-0cec-49a3-a124-5b6ce99419b6 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.374s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:38 user nova-compute[75307]: DEBUG nova.compute.manager [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:01:38 user nova-compute[75307]: WARNING nova.compute.manager [req-49d86caf-2df1-4b29-af43-df26c6ba71a8 req-8e9641cf-e907-40d4-ae03-6f161274ce5f service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state active and task_state None.
Nov 14 00:01:39 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:42 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:01:43 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=25.044437408447266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 2711471b-0c0a-4d87-9f58-37c9b160e352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:01:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:01:44 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:49 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:01:54 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:01:59 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:04 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:07 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Triggering sync for uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 00:02:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:02:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:02:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:02:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:09 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:24 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:02:29 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:02:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:02:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:02:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:02:34 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:02:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:02:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:02:36 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:02:37 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:02:37 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:02:37 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:02:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:02:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:02:43 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:02:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:02:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.043670654296875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 2711471b-0c0a-4d87-9f58-37c9b160e352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:02:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:02:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:02:47 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:02:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:02:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-changed-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG nova.compute.manager [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing instance network info cache due to event network-changed-6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing network info cache for port 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated VIF entry in instance network info cache for port 6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG nova.network.neutron [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:03:23 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-40d28613-6369-4aa3-b9f6-e8b914ce76c7 req-9d109e0a-1acf-4b2c-b30a-7e7f54b9aada service nova] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-changed-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.compute.manager [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing instance network info cache due to event network-changed-6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Refreshing network info cache for port 6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:03:24 user nova-compute[75307]: INFO nova.compute.manager [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Detaching volume c0effee8-9eb1-4170-ab43-741dc03464f1
Nov 14 00:03:24 user nova-compute[75307]: INFO nova.virt.block_device [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Attempting to driver detach volume c0effee8-9eb1-4170-ab43-741dc03464f1 from mountpoint /dev/vdb
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Attempting to detach device vdb from instance 2711471b-0c0a-4d87-9f58-37c9b160e352 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:03:24 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:03:24 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:03:24 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:03:24 user nova-compute[75307]:   <serial>c0effee8-9eb1-4170-ab43-741dc03464f1</serial>
Nov 14 00:03:24 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 00:03:24 user nova-compute[75307]: </disk>
Nov 14 00:03:24 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:03:24 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully detached device vdb from instance 2711471b-0c0a-4d87-9f58-37c9b160e352 from the persistent domain config.
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2711471b-0c0a-4d87-9f58-37c9b160e352 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:03:24 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:03:24 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:03:24 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:03:24 user nova-compute[75307]:   <serial>c0effee8-9eb1-4170-ab43-741dc03464f1</serial>
Nov 14 00:03:24 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 00:03:24 user nova-compute[75307]: </disk>
Nov 14 00:03:24 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated VIF entry in instance network info cache for port 6194118d-a541-4665-a28b-40de7085221a. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.network.neutron [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-a4353453-483e-48c7-81c5-6b24df8605c7 req-edff1c4d-7954-468b-9ee7-e328cf6fe553 service nova] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:03:24 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:03:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:03:38 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:03:39 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [{"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:03:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-2711471b-0c0a-4d87-9f58-37c9b160e352" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:03:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:03:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:03:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:03:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2711471b-0c0a-4d87-9f58-37c9b160e352 is timed out.
Nov 14 00:03:44 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully detached device vdb from instance 2711471b-0c0a-4d87-9f58-37c9b160e352 from the live domain config.
Nov 14 00:03:44 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TIHgbZOS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:03:44 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea49e280-6e11-4b30-b38b-e6431b59942a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:03:44 user nova-compute[75307]: No targets found.
Nov 14 00:03:44 user nova-compute[75307]: iSNS:
Nov 14 00:03:44 user nova-compute[75307]: No targets found.
Nov 14 00:03:44 user nova-compute[75307]: STATIC:
Nov 14 00:03:44 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1
Nov 14 00:03:44 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:03:44 user nova-compute[75307]:                 Iface Name: default
Nov 14 00:03:44 user nova-compute[75307]: FIRMWARE:
Nov 14 00:03:44 user nova-compute[75307]: No targets found.
Nov 14 00:03:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:03:44 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:03:44 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[47868379-344e-4b42-8d0a-aea1c5fc6d03]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[50bdd091-962d-4652-a077-17ae427c3d4d]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:03:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 (non-flash)
Nov 14 00:03:44 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb45a93d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ac13c6-8148-488b-a943-02ff5853a3c7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[3843ac61-530c-498f-8a85-1cac0af632f2]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed4f8bd-5694-4bd0-a51f-2603567e9d55]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[22928668-b6e2-4b64-b0d5-ce9c9aed1107]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd5784a-c999-4ee5-912a-cec30d073545]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:03:44 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbaa86b-0b51-49e9-8067-154f468aebe6]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260]
Nov 14 00:03:45 user nova-compute[75307]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1, portal: 172.16.0.220,3260] successful.
Nov 14 00:03:45 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c0effee8-9eb1-4170-ab43-741dc03464f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93d9364-df97-4bf1-a119-3fc8cdbf8bbf]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== disconnect_volume: return (310ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:03:45 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:03:45 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.042930603027344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance 2711471b-0c0a-4d87-9f58-37c9b160e352 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.163s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG nova.objects.instance [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:03:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-f9b8aa99-c9b5-42a6-a2b7-e14849dbf4b1 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.682s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:03:47 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:03:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:03:55 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:04:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:16 user nova-compute[75307]: INFO nova.compute.manager [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Terminating instance
Nov 14 00:04:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:16 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-b609c105-df94-4eb7-9a48-82d2fae06bdb req-8a116a56-99ad-4afa-96c8-170ab003e26e service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-unplugged-6194118d-a541-4665-a28b-40de7085221a for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Instance destroyed successfully.
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.objects.instance [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'resources' on Instance uuid 2711471b-0c0a-4d87-9f58-37c9b160e352 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-13T23:59:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1267095709',display_name='tempest-TestMinimumBasicScenario-server-1267095709',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1267095709',id=51,image_ref='38e23742-0819-4c20-916e-b0cab895fada',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCqHbbjFzUnqFBZjm2MCN3CwUSeFaoPy+S+kl5CGea1y/GX9BzgYld7E9Nu68mfJYYp650bGgYBWVgkcR0LXYnu8YbqDc9zZierdOuwU+FQvuIu1fcN7Ykagas1HXe1bXg==',key_name='tempest-TestMinimumBasicScenario-1299452970',keypairs=<?>,launch_index=0,launched_at=2023-11-13T23:59:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-pbxfgn6w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='38e23742-0819-4c20-916e-b0cab895fada',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:01:38Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=2711471b-0c0a-4d87-9f58-37c9b160e352,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "6194118d-a541-4665-a28b-40de7085221a", "address": "fa:16:3e:97:84:74", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6194118d-a5", "ovs_interfaceid": "6194118d-a541-4665-a28b-40de7085221a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG os_vif [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6194118d-a5, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68e7705c-dbbb-4d1b-a627-d45dd870bfe3) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:17 user nova-compute[75307]: INFO os_vif [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:84:74,bridge_name='br-int',has_traffic_filtering=True,id=6194118d-a541-4665-a28b-40de7085221a,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6194118d-a5')
Nov 14 00:04:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Deleting instance files /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352_del
Nov 14 00:04:17 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Deletion of /opt/stack/data/nova/instances/2711471b-0c0a-4d87-9f58-37c9b160e352_del complete
Nov 14 00:04:17 user nova-compute[75307]: INFO nova.compute.manager [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 00:04:17 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:04:17 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:04:18 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:04:18 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Took 0.51 seconds to deallocate network for instance.
Nov 14 00:04:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:18 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:04:18 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:04:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:18 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Deleted allocations for instance 2711471b-0c0a-4d87-9f58-37c9b160e352
Nov 14 00:04:18 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-74f8cd27-824c-4094-a346-c8e60ead7e05 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.679s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:04:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] Acquiring lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] Lock "2711471b-0c0a-4d87-9f58-37c9b160e352-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] No waiting events found dispatching network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:04:19 user nova-compute[75307]: WARNING nova.compute.manager [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received unexpected event network-vif-plugged-6194118d-a541-4665-a28b-40de7085221a for instance with vm_state deleted and task_state None.
Nov 14 00:04:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-73f79b6c-26c0-4f5c-b0fa-df7ec595963f req-1ee40fbc-0146-4066-8921-42d125fe9b57 service nova] [instance: 2711471b-0c0a-4d87-9f58-37c9b160e352] Received event network-vif-deleted-6194118d-a541-4665-a28b-40de7085221a {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:04:22 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:27 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:32 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:35 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:37 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:04:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:04:38 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:04:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:04:42 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:04:46 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:04:46 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9122MB free_disk=25.07025146484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:04:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.150s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:04:47 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:04:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:52 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:04:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:04:57 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:02 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:07 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:07 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Starting instance... {{(pid=75307) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75307) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 00:05:10 user nova-compute[75307]: INFO nova.compute.claims [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Claim successful on node user
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Start building networks asynchronously for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Allocating IP information in the background. {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 00:05:10 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] allocate_for_instance() {{(pid=75307) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 00:05:10 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.policy [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '06052d28274541aba86950780c2d5616', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0af376c8d42c4a49b9417ea0056a3ab4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75307) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Start building block device mappings for instance. {{(pid=75307) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Start spawning the instance on the hypervisor. {{(pid=75307) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Creating instance directory {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 00:05:11 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Creating image(s)
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "/opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "/opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "/opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.part --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Successfully created port: 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.virt.images [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] 6a745e1b-b1a1-4751-af50-54312749a380 was qcow2, converting to raw {{(pid=75307) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG nova.privsep.utils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75307) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 00:05:11 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.part /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.converted {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.part /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.converted" returned: 0 in 0.248s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.converted --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.933s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json" returned: 0 in 0.167s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf,backing_fmt=raw /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk 1073741824 {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Successfully updated port: 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.compute.manager [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing instance network info cache due to event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf,backing_fmt=raw /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk 1073741824" returned: 0 in 0.151s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "495fbc0f8a8dc927c611e0e2357e139633ad03bf" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-7279373e-af7c-47ef-97fb-88391fcbe47f req-3a28f243-caa3-403d-8bd3-a809129d946d service nova] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/495fbc0f8a8dc927c611e0e2357e139633ad03bf --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk. size=1073741824 {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:12 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance cache missing network info. {{(pid=75307) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.disk.api [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Cannot resize image /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk to a smaller size. {{(pid=75307) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Created local disks {{(pid=75307) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Ensure instance console log exists: /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/console.log {{(pid=75307) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.network.neutron [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance network_info: |[{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75307) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Start _get_guest_xml network_info=[{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:05:08Z,direct_url=<?>,disk_format='qcow2',id=6a745e1b-b1a1-4751-af50-54312749a380,min_disk=0,min_ram=0,name='tempest-scenario-img--1509951425',owner='0af376c8d42c4a49b9417ea0056a3ab4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:05:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'size': 0, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'device_type': 'disk', 'encrypted': False, 'disk_bus': 'virtio', 'image_id': '6a745e1b-b1a1-4751-af50-54312749a380'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 00:05:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:05:13 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller missing on host. {{(pid=75307) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.host [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU controller found on host. {{(pid=75307) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75307) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-13T23:10:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T00:05:08Z,direct_url=<?>,disk_format='qcow2',id=6a745e1b-b1a1-4751-af50-54312749a380,min_disk=0,min_ram=0,name='tempest-scenario-img--1509951425',owner='0af376c8d42c4a49b9417ea0056a3ab4',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T00:05:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image limits 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flavor pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Image pref 0:0:0 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75307) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Got 1 possible topologies {{(pid=75307) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.hardware [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75307) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:05:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1855320741',display_name='tempest-TestMinimumBasicScenario-server-1855320741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1855320741',id=52,image_ref='6a745e1b-b1a1-4751-af50-54312749a380',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWmqFQyTOM+ct79ZhW1pLXuIClqJ5QZO7qrK32q0kKuAld5jGcX1QRsyuerMvzc0gRs8cm8hqYplca8e1FSIasgmzpusuNwlXcse5m4NZuc+PVPxj03unj2wXCCb8zlCg==',key_name='tempest-TestMinimumBasicScenario-959275867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-s0hsjcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6a745e1b-b1a1-4751-af50-54312749a380',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:05:11Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=a4d33213-3235-43ba-927b-29bb174b80b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75307) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.objects.instance [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'pci_devices' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 00:05:13 user nova-compute[75307]:   <uuid>a4d33213-3235-43ba-927b-29bb174b80b2</uuid>
Nov 14 00:05:13 user nova-compute[75307]:   <name>instance-00000034</name>
Nov 14 00:05:13 user nova-compute[75307]:   <memory>524288</memory>
Nov 14 00:05:13 user nova-compute[75307]:   <vcpu>1</vcpu>
Nov 14 00:05:13 user nova-compute[75307]:   <metadata>
Nov 14 00:05:13 user nova-compute[75307]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 00:05:13 user nova-compute[75307]:       <nova:package version="0.0.0"/>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:name>tempest-TestMinimumBasicScenario-server-1855320741</nova:name>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:creationTime>2023-11-14 00:05:13</nova:creationTime>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:flavor name="m1.tiny">
Nov 14 00:05:13 user nova-compute[75307]:         <nova:memory>512</nova:memory>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:disk>1</nova:disk>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:swap>0</nova:swap>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:vcpus>1</nova:vcpus>
Nov 14 00:05:13 user nova-compute[75307]:       </nova:flavor>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:owner>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:user uuid="06052d28274541aba86950780c2d5616">tempest-TestMinimumBasicScenario-1936842614-project-member</nova:user>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:project uuid="0af376c8d42c4a49b9417ea0056a3ab4">tempest-TestMinimumBasicScenario-1936842614</nova:project>
Nov 14 00:05:13 user nova-compute[75307]:       </nova:owner>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:root type="image" uuid="6a745e1b-b1a1-4751-af50-54312749a380"/>
Nov 14 00:05:13 user nova-compute[75307]:       <nova:ports>
Nov 14 00:05:13 user nova-compute[75307]:         <nova:port uuid="2ac6c823-120e-49b4-a124-0adcfe19ad99">
Nov 14 00:05:13 user nova-compute[75307]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 00:05:13 user nova-compute[75307]:         </nova:port>
Nov 14 00:05:13 user nova-compute[75307]:       </nova:ports>
Nov 14 00:05:13 user nova-compute[75307]:     </nova:instance>
Nov 14 00:05:13 user nova-compute[75307]:   </metadata>
Nov 14 00:05:13 user nova-compute[75307]:   <sysinfo type="smbios">
Nov 14 00:05:13 user nova-compute[75307]:     <system>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="product">OpenStack Nova</entry>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="version">0.0.0</entry>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="serial">a4d33213-3235-43ba-927b-29bb174b80b2</entry>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="uuid">a4d33213-3235-43ba-927b-29bb174b80b2</entry>
Nov 14 00:05:13 user nova-compute[75307]:       <entry name="family">Virtual Machine</entry>
Nov 14 00:05:13 user nova-compute[75307]:     </system>
Nov 14 00:05:13 user nova-compute[75307]:   </sysinfo>
Nov 14 00:05:13 user nova-compute[75307]:   <os>
Nov 14 00:05:13 user nova-compute[75307]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 00:05:13 user nova-compute[75307]:     <boot dev="hd"/>
Nov 14 00:05:13 user nova-compute[75307]:     <smbios mode="sysinfo"/>
Nov 14 00:05:13 user nova-compute[75307]:   </os>
Nov 14 00:05:13 user nova-compute[75307]:   <features>
Nov 14 00:05:13 user nova-compute[75307]:     <acpi/>
Nov 14 00:05:13 user nova-compute[75307]:     <apic/>
Nov 14 00:05:13 user nova-compute[75307]:     <vmcoreinfo/>
Nov 14 00:05:13 user nova-compute[75307]:   </features>
Nov 14 00:05:13 user nova-compute[75307]:   <clock offset="utc">
Nov 14 00:05:13 user nova-compute[75307]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 00:05:13 user nova-compute[75307]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 00:05:13 user nova-compute[75307]:     <timer name="hpet" present="no"/>
Nov 14 00:05:13 user nova-compute[75307]:   </clock>
Nov 14 00:05:13 user nova-compute[75307]:   <cpu mode="custom" match="exact">
Nov 14 00:05:13 user nova-compute[75307]:     <model>Nehalem</model>
Nov 14 00:05:13 user nova-compute[75307]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 00:05:13 user nova-compute[75307]:   </cpu>
Nov 14 00:05:13 user nova-compute[75307]:   <devices>
Nov 14 00:05:13 user nova-compute[75307]:     <disk type="file" device="disk">
Nov 14 00:05:13 user nova-compute[75307]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 00:05:13 user nova-compute[75307]:       <source file="/opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk"/>
Nov 14 00:05:13 user nova-compute[75307]:       <target dev="vda" bus="virtio"/>
Nov 14 00:05:13 user nova-compute[75307]:     </disk>
Nov 14 00:05:13 user nova-compute[75307]:     <interface type="ethernet">
Nov 14 00:05:13 user nova-compute[75307]:       <mac address="fa:16:3e:96:4d:32"/>
Nov 14 00:05:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 14 00:05:13 user nova-compute[75307]:       <mtu size="1442"/>
Nov 14 00:05:13 user nova-compute[75307]:       <target dev="tap2ac6c823-12"/>
Nov 14 00:05:13 user nova-compute[75307]:     </interface>
Nov 14 00:05:13 user nova-compute[75307]:     <serial type="pty">
Nov 14 00:05:13 user nova-compute[75307]:       <log file="/opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/console.log" append="off"/>
Nov 14 00:05:13 user nova-compute[75307]:     </serial>
Nov 14 00:05:13 user nova-compute[75307]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 00:05:13 user nova-compute[75307]:     <video>
Nov 14 00:05:13 user nova-compute[75307]:       <model type="virtio"/>
Nov 14 00:05:13 user nova-compute[75307]:     </video>
Nov 14 00:05:13 user nova-compute[75307]:     <rng model="virtio">
Nov 14 00:05:13 user nova-compute[75307]:       <backend model="random">/dev/urandom</backend>
Nov 14 00:05:13 user nova-compute[75307]:     </rng>
Nov 14 00:05:13 user nova-compute[75307]:     <controller type="usb" index="0" model="none"/>
Nov 14 00:05:13 user nova-compute[75307]:     <memballoon model="virtio">
Nov 14 00:05:13 user nova-compute[75307]:       <stats period="10"/>
Nov 14 00:05:13 user nova-compute[75307]:     </memballoon>
Nov 14 00:05:13 user nova-compute[75307]:   </devices>
Nov 14 00:05:13 user nova-compute[75307]: </domain>
Nov 14 00:05:13 user nova-compute[75307]:  {{(pid=75307) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:05:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1855320741',display_name='tempest-TestMinimumBasicScenario-server-1855320741',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1855320741',id=52,image_ref='6a745e1b-b1a1-4751-af50-54312749a380',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWmqFQyTOM+ct79ZhW1pLXuIClqJ5QZO7qrK32q0kKuAld5jGcX1QRsyuerMvzc0gRs8cm8hqYplca8e1FSIasgmzpusuNwlXcse5m4NZuc+PVPxj03unj2wXCCb8zlCg==',key_name='tempest-TestMinimumBasicScenario-959275867',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-s0hsjcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6a745e1b-b1a1-4751-af50-54312749a380',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T00:05:11Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=a4d33213-3235-43ba-927b-29bb174b80b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG os_vif [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12') {{(pid=75307) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bdefeae3-0218-5b0a-af0a-fb7a73de4e0e', '_type': 'linux-noop'}}, row=False) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ac6c823-12, may_exist=True, interface_attrs={}) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ac6c823-12, col_values=(('qos', UUID('44b7bd31-777e-4416-8b09-22ffc0d43877')),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ac6c823-12, col_values=(('external_ids', {'iface-id': '2ac6c823-120e-49b4-a124-0adcfe19ad99', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:4d:32', 'vm-uuid': 'a4d33213-3235-43ba-927b-29bb174b80b2'}),), if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:13 user nova-compute[75307]: INFO os_vif [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12')
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:05:13 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No VIF found with MAC fa:16:3e:96:4d:32, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:05:14 user nova-compute[75307]: WARNING nova.compute.manager [req-01bfb191-f29d-453c-84b4-bdc86c65091d req-8d73b623-8d3a-40b4-9604-b8b60a9d646a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state building and task_state spawning.
Nov 14 00:05:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance event wait completed in 0 seconds for  {{(pid=75307) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Guest created on hypervisor {{(pid=75307) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 00:05:16 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance spawned successfully.
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_cdrom_bus of ide {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_disk_bus of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_input_bus of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_pointer_model of None {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_video_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Found default for hw_vif_model of virtio {{(pid=75307) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 00:05:16 user nova-compute[75307]: INFO nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Took 5.46 seconds to spawn the instance on the hypervisor.
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:16 user nova-compute[75307]: DEBUG nova.compute.manager [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:05:16 user nova-compute[75307]: WARNING nova.compute.manager [req-c8b66948-860a-42c9-bce8-a955ef80ab9c req-04ad8baa-473a-4cb7-af2a-17c122536a2a service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state building and task_state spawning.
Nov 14 00:05:16 user nova-compute[75307]: INFO nova.compute.manager [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Took 6.10 seconds to build instance.
Nov 14 00:05:16 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-0209e4c0-85fd-4a8e-8e86-ee8aff52cd5b tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.206s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:37 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:05:39 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:05:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:43 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:45 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:05:46 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:05:46 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=25.019859313964844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a4d33213-3235-43ba-927b-29bb174b80b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:05:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.453s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:05:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:54 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:05:57 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:05:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:19 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 00:06:19 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] There are 0 instances to clean {{(pid=75307) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 00:06:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:25 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:38 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:06:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:06:41 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:06:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:06:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:06:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:42 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:06:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:06:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:06:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:06:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8991MB free_disk=25.01921844482422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a4d33213-3235-43ba-927b-29bb174b80b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:06:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:06:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:50 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:06:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:06:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:06:58 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:03 user nova-compute[75307]: INFO nova.compute.manager [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Attaching volume 80a131ec-3c11-4cb8-8f39-c87b25c064a2 to /dev/vdb
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9018076-1cfb-4f56-89a3-d37995998dc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:ff618d9bdb90\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5cbc80-87a2-41af-b2a1-1f5eb864b791]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61b5823-2e95-4be0-a6c6-769db8c097ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbc625d-dba4-4d79-ba3d-66d6f75ca8cd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Running cmd (subprocess): nvme version {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] 'nvme version' failed. Not Retrying. {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] nvme not present on system {{(pid=75307) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 00:07:03 user nova-compute[75307]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 00:07:03 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1761124-8696-4024-9472-c31ede5e7ec0]: (4, '') {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75307) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.lightos [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] LIGHTOS: no hostnqn found. {{(pid=75307) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG os_brick.utils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:ff618d9bdb90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:07:03 user nova-compute[75307]: DEBUG nova.virt.block_device [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating existing volume attachment record: 942c2d68-3d8e-4221-a331-9b291f1b3fa0 {{(pid=75307) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Calling os-brick to attach iSCSI Volume {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXihevdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:07:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:07:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:07:07 user nova-compute[75307]: INFO os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[01277852-1740-46d9-95e7-4e6a863e3d5a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 00:07:07 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34e0ac9-4e14-4117-a487-271363b5b90c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2] added\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2] added
Nov 14 00:07:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1327ea4-88c1-4442-9235-5a3d1e361123]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[65db3082-53fa-478e-a4b0-9b91c8cab8b8]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXihevdH {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AXihevdH" returned: 0 in 0.024s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c9b0ac-c4ca-44e1-84b9-8312ccda961c]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AXihevdH'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[524720f8-4d53-4f41-a4bd-ff32f89786ae]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3fee6e-44be-4888-8eff-93e2af946ba8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:07:07 user nova-compute[75307]:  {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 00:07:07 user nova-compute[75307]:  {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:07:07 user nova-compute[75307]: WARNING os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 00:07:07 user nova-compute[75307]: 
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --login {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d411fc-c627-495e-b631-d40dca9a7209]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260]
Nov 14 00:07:07 user nova-compute[75307]: Login to [iface: default, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260] successful.
Nov 14 00:07:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51bc3d7-6bbf-4064-9098-8a18c82b68da]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[398cc9f0-615d-474c-afab-bf0a97141627]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)
Nov 14 00:07:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)
Nov 14 00:07:07 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to 172.16.0.220:3260 {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75307) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75307) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c128c2d-ab6d-48cb-81d2-052277b3b2c8]: (4, ('- - 0', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:07:07 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75307) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXihevdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75307) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '26431396133303636', 'path': '/dev/sdb'} {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431396133303636', 'path': '/dev/sdb'} {{(pid=75307) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG nova.objects.instance [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:07:08 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 00:07:08 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:07:08 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:07:08 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:07:08 user nova-compute[75307]:   <serial>80a131ec-3c11-4cb8-8f39-c87b25c064a2</serial>
Nov 14 00:07:08 user nova-compute[75307]: </disk>
Nov 14 00:07:08 user nova-compute[75307]:  {{(pid=75307) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 00:07:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vda, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:07:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75307) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 00:07:09 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] No VIF found with MAC fa:16:3e:96:4d:32, not building metadata {{(pid=75307) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 00:07:09 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1d1b3660-fcfc-4237-9442-f6aeeb3840ba tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.039s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:11 user nova-compute[75307]: DEBUG nova.compute.manager [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing instance network info cache due to event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:07:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:07:11 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:07:11 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:07:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated VIF entry in instance network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:07:12 user nova-compute[75307]: DEBUG nova.network.neutron [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:07:12 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-1cbb9a47-9484-4a48-a5a6-774d87b7896a req-acdb7659-8bc7-4486-a863-d27d19e1b7ad service nova] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:07:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.compute.manager [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing instance network info cache due to event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated VIF entry in instance network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.network.neutron [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:14 user nova-compute[75307]: INFO nova.compute.manager [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Rebooting instance
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-c77794bb-d465-41fd-9b28-2b4c3c9fd4d0 req-12b469d8-aa80-4ae7-b77d-11ff73748011 service nova] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:07:14 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Building network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 00:07:15 user nova-compute[75307]: DEBUG nova.network.neutron [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:07:15 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:07:15 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:17 user nova-compute[75307]: DEBUG nova.compute.manager [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:07:17 user nova-compute[75307]: WARNING nova.compute.manager [req-28e8ff2c-aeec-44c8-a79d-2b85977ff3fa req-dc82a825-2307-48a0-8277-092afb8444ea service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state active and task_state reboot_started.
Nov 14 00:07:18 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance shutdown successfully.
Nov 14 00:07:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:19 user nova-compute[75307]: DEBUG nova.compute.manager [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:07:19 user nova-compute[75307]: WARNING nova.compute.manager [req-42d7c8f4-df57-4c6f-8e7e-90af4bc23de8 req-a00b12bf-85b2-4629-aa4a-d84034c09219 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state active and task_state reboot_started.
Nov 14 00:07:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:07:21 user nova-compute[75307]: WARNING nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state active and task_state reboot_started.
Nov 14 00:07:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:07:21 user nova-compute[75307]: WARNING nova.compute.manager [req-98662e14-26da-4d83-8e54-ad2431041f17 req-0b175052-8ceb-404b-9e57-89694cba9ef1 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state active and task_state reboot_started.
Nov 14 00:07:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance running successfully.
Nov 14 00:07:21 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance soft rebooted successfully.
Nov 14 00:07:21 user nova-compute[75307]: DEBUG nova.compute.manager [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Checking state {{(pid=75307) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 00:07:21 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-1ba3d598-13bb-4ccf-9257-0e4f371b2cbc tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.166s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:07:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:39 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:07:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:07:41 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:07:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:07:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:07:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:46 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:07:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:07:47 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.017227172851562GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a4d33213-3235-43ba-927b-29bb174b80b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:07:47 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:07:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:48 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:07:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:07:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:08:40 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:08:41 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:08:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:08:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:08:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:08:48 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75307) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 00:08:49 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:08:49 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8979MB free_disk=25.016693115234375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a4d33213-3235-43ba-927b-29bb174b80b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:08:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:08:50 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:50 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:08:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:08:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:00 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:03 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG nova.compute.manager [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing instance network info cache due to event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated VIF entry in instance network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG nova.network.neutron [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:09:06 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-306693ae-e67b-4c74-8a47-32ec20496b57 req-bebc8722-a5fb-4209-a049-24f18c735c5b service nova] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.compute.manager [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing instance network info cache due to event network-changed-2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Refreshing network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:09:07 user nova-compute[75307]: INFO nova.compute.manager [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Detaching volume 80a131ec-3c11-4cb8-8f39-c87b25c064a2
Nov 14 00:09:07 user nova-compute[75307]: INFO nova.virt.block_device [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Attempting to driver detach volume 80a131ec-3c11-4cb8-8f39-c87b25c064a2 from mountpoint /dev/vdb
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Attempting to detach device vdb from instance a4d33213-3235-43ba-927b-29bb174b80b2 from the persistent domain config. {{(pid=75307) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:09:07 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:09:07 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:09:07 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:09:07 user nova-compute[75307]:   <serial>80a131ec-3c11-4cb8-8f39-c87b25c064a2</serial>
Nov 14 00:09:07 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:09:07 user nova-compute[75307]: </disk>
Nov 14 00:09:07 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:09:07 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully detached device vdb from instance a4d33213-3235-43ba-927b-29bb174b80b2 from the persistent domain config.
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a4d33213-3235-43ba-927b-29bb174b80b2 from the live domain config. {{(pid=75307) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.guest [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 00:09:07 user nova-compute[75307]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 00:09:07 user nova-compute[75307]:   <source dev="/dev/sdb"/>
Nov 14 00:09:07 user nova-compute[75307]:   <target dev="vdb" bus="virtio"/>
Nov 14 00:09:07 user nova-compute[75307]:   <serial>80a131ec-3c11-4cb8-8f39-c87b25c064a2</serial>
Nov 14 00:09:07 user nova-compute[75307]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 00:09:07 user nova-compute[75307]: </disk>
Nov 14 00:09:07 user nova-compute[75307]:  {{(pid=75307) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated VIF entry in instance network info cache for port 2ac6c823-120e-49b4-a124-0adcfe19ad99. {{(pid=75307) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.network.neutron [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-86d6a195-cc40-4bb4-a425-7867cdd8a1f4 req-63b2c96b-df19-487d-b381-a89fae7e1fc5 service nova] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:09:07 user nova-compute[75307]: DEBUG nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 00:09:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:08 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:08 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:13 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:18 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:23 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:27 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a4d33213-3235-43ba-927b-29bb174b80b2 is timed out.
Nov 14 00:09:27 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully detached device vdb from instance a4d33213-3235-43ba-927b-29bb174b80b2 from the live domain config.
Nov 14 00:09:27 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] calling os-brick to detach iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcb3c2433a0>, {'target_iqn': 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AXihevdH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 00:09:27 user nova-compute[75307]: WARNING os_brick.initiator.connectors.base [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f2af40-1a48-4edb-bf0f-60ea146b62a5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 00:09:27 user nova-compute[75307]: No targets found.
Nov 14 00:09:27 user nova-compute[75307]: iSNS:
Nov 14 00:09:27 user nova-compute[75307]: No targets found.
Nov 14 00:09:27 user nova-compute[75307]: STATIC:
Nov 14 00:09:27 user nova-compute[75307]: Target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2
Nov 14 00:09:27 user nova-compute[75307]:         Portal: 172.16.0.220:3260,-1
Nov 14 00:09:27 user nova-compute[75307]:                 Iface Name: default
Nov 14 00:09:27 user nova-compute[75307]: FIRMWARE:
Nov 14 00:09:27 user nova-compute[75307]: No targets found.
Nov 14 00:09:27 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 00:09:27 user nova-compute[75307]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 00:09:27 user nova-compute[75307]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75307) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2', 0)] {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a394677-d908-4d59-bfa4-a6f0e808a3b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:27 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c9148c-14e6-4a51-8341-c02ed2f9bef9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)
Nov 14 00:09:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 (non-flash)
Nov 14 00:09:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcb3c3f05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2'): ({'sdb'}, set())}) {{(pid=75307) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Removing single pathed devices sdb {{(pid=75307) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f34991-4507-495a-8196-d7437a73c17a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f03f9a9-2b25-489e-829f-ea289d0d17bb]: (4, ('ok\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Flushing IO for device /dev/sdb {{(pid=75307) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6647bda-e8c1-4bd6-a242-93ec9db8e06f]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75307) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[47477a4e-2812-4bb5-bc07-d6b03688b09f]: (4, ('1', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.linuxscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] SCSI volumes sdb have been removed. {{(pid=75307) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2')] {{(pid=75307) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd7a4f-19dd-422e-80fe-bc50250adc18]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --logout {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4eeb13-d52c-4eac-8278-0181bf02fa79]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260]
Nov 14 00:09:28 user nova-compute[75307]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2, portal: 172.16.0.220,3260] successful.
Nov 14 00:09:28 user nova-compute[75307]:  stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op delete {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80a131ec-3c11-4cb8-8f39-c87b25c064a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85241) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc123d6-3235-4250-a1db-26d90cfec3da]: (4, ('', '')) {{(pid=85241) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75307) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.base [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] <== disconnect_volume: return (307ms) None {{(pid=75307) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Disconnected iSCSI Volume {{(pid=75307) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG nova.objects.instance [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'flavor' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:09:28 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-e5c59582-19d1-4759-aa16-b81e4f4edb62 tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.580s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:33 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:38 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquired lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Forcefully refreshing network info cache for instance {{(pid=75307) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 00:09:41 user nova-compute[75307]: DEBUG nova.objects.instance [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lazy-loading 'info_cache' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:09:42 user nova-compute[75307]: DEBUG nova.network.neutron [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [{"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:09:42 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Releasing lock "refresh_cache-a4d33213-3235-43ba-927b-29bb174b80b2" {{(pid=75307) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 00:09:42 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updated the network info_cache for instance {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 00:09:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:09:43 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:44 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:44 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:09:48 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:49 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG oslo_concurrency.processutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75307) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 00:09:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:09:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=8962MB free_disk=25.015911102294922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Instance a4d33213-3235-43ba-927b-29bb174b80b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75307) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:09:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:09:52 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:09:54 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:09:58 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:00 user nova-compute[75307]: INFO nova.compute.manager [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Terminating instance
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.compute.manager [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Start destroying the instance on the hypervisor. {{(pid=75307) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.compute.manager [req-760f8d72-7f10-4f65-9c72-4f08b2097579 req-b373310c-1bff-4484-bf05-bb4e7f6934bf service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-unplugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with task_state deleting. {{(pid=75307) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 00:10:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Instance destroyed successfully.
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.objects.instance [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lazy-loading 'resources' on Instance uuid a4d33213-3235-43ba-927b-29bb174b80b2 {{(pid=75307) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.virt.libvirt.vif [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T00:05:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1855320741',display_name='tempest-TestMinimumBasicScenario-server-1855320741',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1855320741',id=52,image_ref='6a745e1b-b1a1-4751-af50-54312749a380',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWmqFQyTOM+ct79ZhW1pLXuIClqJ5QZO7qrK32q0kKuAld5jGcX1QRsyuerMvzc0gRs8cm8hqYplca8e1FSIasgmzpusuNwlXcse5m4NZuc+PVPxj03unj2wXCCb8zlCg==',key_name='tempest-TestMinimumBasicScenario-959275867',keypairs=<?>,launch_index=0,launched_at=2023-11-14T00:05:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0af376c8d42c4a49b9417ea0056a3ab4',ramdisk_id='',reservation_id='r-s0hsjcic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='6a745e1b-b1a1-4751-af50-54312749a380',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1936842614',owner_user_name='tempest-TestMinimumBasicScenario-1936842614-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T00:07:22Z,user_data=None,user_id='06052d28274541aba86950780c2d5616',uuid=a4d33213-3235-43ba-927b-29bb174b80b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converting VIF {"id": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "address": "fa:16:3e:96:4d:32", "network": {"id": "900735d9-696c-48f3-a131-a6853405367d", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-351949653-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0af376c8d42c4a49b9417ea0056a3ab4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ac6c823-12", "ovs_interfaceid": "2ac6c823-120e-49b4-a124-0adcfe19ad99", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.network.os_vif_util [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12') {{(pid=75307) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG os_vif [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12') {{(pid=75307) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ac6c823-12, bridge=br-int, if_exists=True) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44b7bd31-777e-4416-8b09-22ffc0d43877) {{(pid=75307) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:00 user nova-compute[75307]: INFO os_vif [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:4d:32,bridge_name='br-int',has_traffic_filtering=True,id=2ac6c823-120e-49b4-a124-0adcfe19ad99,network=Network(900735d9-696c-48f3-a131-a6853405367d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ac6c823-12')
Nov 14 00:10:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Deleting instance files /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2_del
Nov 14 00:10:00 user nova-compute[75307]: INFO nova.virt.libvirt.driver [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Deletion of /opt/stack/data/nova/instances/a4d33213-3235-43ba-927b-29bb174b80b2_del complete
Nov 14 00:10:00 user nova-compute[75307]: INFO nova.compute.manager [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 00:10:00 user nova-compute[75307]: DEBUG oslo.service.loopingcall [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75307) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.compute.manager [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Deallocating network for instance {{(pid=75307) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 00:10:00 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] deallocate_for_instance() {{(pid=75307) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG nova.network.neutron [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Updating instance_info_cache with network_info: [] {{(pid=75307) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 00:10:01 user nova-compute[75307]: INFO nova.compute.manager [-] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Took 0.45 seconds to deallocate network for instance.
Nov 14 00:10:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG nova.compute.manager [req-d7509261-d933-4af2-ba8a-4ff57f1d381e req-2013c841-bdae-47af-978c-ccca6113ab0f service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-deleted-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:10:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:01 user nova-compute[75307]: INFO nova.scheduler.client.report [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Deleted allocations for instance a4d33213-3235-43ba-927b-29bb174b80b2
Nov 14 00:10:01 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-d367483c-34dc-408e-bcce-911c08cb31ff tempest-TestMinimumBasicScenario-1936842614 tempest-TestMinimumBasicScenario-1936842614-project-member] Lock "a4d33213-3235-43ba-927b-29bb174b80b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.629s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 00:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] Acquiring lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:02 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] Lock "a4d33213-3235-43ba-927b-29bb174b80b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:02 user nova-compute[75307]: DEBUG nova.compute.manager [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] No waiting events found dispatching network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 {{(pid=75307) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 00:10:02 user nova-compute[75307]: WARNING nova.compute.manager [req-be0e5750-e1c5-4eb7-b1cf-1ddee9409d29 req-6dec09de-6ecc-4a12-b888-18b3310ce34d service nova] [instance: a4d33213-3235-43ba-927b-29bb174b80b2] Received unexpected event network-vif-plugged-2ac6c823-120e-49b4-a124-0adcfe19ad99 for instance with vm_state deleted and task_state None.
Nov 14 00:10:02 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:20 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:25 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:30 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:35 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:40 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:41 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Starting heal instance info cache {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 00:10:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Rebuilding the list of instances to heal {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 00:10:41 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Didn't find any instances for network info cache update. {{(pid=75307) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 00:10:42 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:10:45 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:46 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:46 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75307) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 00:10:49 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:49 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:49 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Auditing locally available compute resources for user (node: user) {{(pid=75307) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 00:10:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:10:50 user nova-compute[75307]: WARNING nova.virt.libvirt.driver [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.046436309814453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75307) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75307) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing inventories for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating ProviderTree inventory for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Updating inventory in ProviderTree for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing aggregate associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, aggregates: None {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Refreshing trait associations for resource provider 29c847ea-f19e-4e70-a7de-654601b2bd95, traits: COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VOLUME_EXTEND,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,HW_CPU_X86_SSSE3,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_MMX,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_SSE42,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VIOMMU_MODEL_AUTO {{(pid=75307) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.provider_tree [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed in ProviderTree for provider: 29c847ea-f19e-4e70-a7de-654601b2bd95 {{(pid=75307) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.scheduler.client.report [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Inventory has not changed for provider 29c847ea-f19e-4e70-a7de-654601b2bd95 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75307) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG nova.compute.resource_tracker [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Compute_service record updated for user:user {{(pid=75307) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG oslo_concurrency.lockutils [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.256s {{(pid=75307) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 00:10:50 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:51 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:52 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:52 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:53 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:53 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:10:55 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:10:56 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:11:00 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:11:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:11:03 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:11:03 user nova-compute[75307]: DEBUG nova.compute.manager [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75307) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75307) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75307) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 00:11:05 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:11:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:11:10 user nova-compute[75307]: DEBUG oslo_service.periodic_task [None req-32616ffe-3bc8-4e56-af94-be5f3432caf9 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75307) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 00:11:10 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 00:11:15 user nova-compute[75307]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75307) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}